Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-10091

Support for CDCR using an external queueing service

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: CDCR
    • Labels:

      Description

      The idea is to contribute part of the work presented here:
      https://www.youtube.com/watch?v=83vbY9f3nXA

      Specifically these components:

      • update processor that writes updates to an external queueing service (abstracted by an interface)
      • a Kafka implementation of this interface (that goes into /contrib?) so anyone using kafka can use this "out of the box"
      • a consumer application

      For the consumer application, the idea is an app that's queue-agnostic and then the queue-specific consumer bit is loaded at runtime. In this case, there's a "default" kafka consumer in there as well.

      I'm not exactly sure what the best structure would be for these pieces (the kafka implementations and the general consumer app code), so I'll simply post class definitions here and let the community decide where they should go.

      The core work is finished. I just need to clean it up a bit and convert the tests to fit this repo (right now they're using an external framework).

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              obates Oliver Bates
            • Votes:
              2 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated: