Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4400

Prefix for sink task consumer groups should be configurable

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 0.10.1.0
    • None
    • connect

    Description

      Currently the prefix for creating consumer groups is fixed. This means that if you run multiple Connect clusters using the same Kafka cluster and create connectors with the same name, sink tasks in different clusters will join the same group. Making this prefix configurable at the worker level would protect against this.

      An alternative would be to define unique cluster IDs for each connect cluster, which would allow us to construct a unique name for the group without requiring yet another config (but presents something of a compatibility challenge).

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              ewencp Ewen Cheslack-Postava
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: