Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4060

Remove ZkClient dependency in Kafka Streams

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.10.2.0
    • Component/s: streams
    • Labels:

      Description

      In Kafka Streams we need to dynamically create or update those internal topics (i.e. repartition topics) upon rebalance, inside InternalTopicManager which is triggered by StreamPartitionAssignor. Currently we are using ZkClient to talk to ZK directly for such actions.

      With create and delete topics request merged in by Grant Henke as part of KIP-4, we should now be able to remove the ZkClient dependency and directly use these requests.

      Related:
      1. KIP-4. https://cwiki.apache.org/confluence/display/KAFKA/KIP-4+-+Command+line+and+centralized+administrative+operations

      2. Consumer Reblance Protocol. https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Client-side+Assignment+Proposal

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                hjafarpour Hojjat Jafarpour
                Reporter:
                guozhang Guozhang Wang
                Reviewer:
                Guozhang Wang
              • Votes:
                1 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: