Kafka
  1. Kafka
  2. KAFKA-47 Create topic support and new ZK data structures for intra-cluster replication
  3. KAFKA-329

Remove the watches/broker for new topics and partitions and change create topic admin API to send start replica state change to all brokers

    Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 0.8.0
    • Component/s: None
    • Labels:

      Description

      Currently in 0.8, all brokers register a watch on /brokers/topics and /brokers/topics/[topic] for all topics in a Kafka cluster. The watches are required to discover new topics.
      There is another way this can be achieved, as proposed here - https://cwiki.apache.org/confluence/display/KAFKA/Kafka+replication+detailed+design+V2#KafkareplicationdetaileddesignV2-Createtopic

      Basically, the create-topic admin command sends start-replica state change request to all brokers in the assigned replicas list.

      1. KAFKA-329-v1.patch
        40 kB
        Prashanth Menon
      2. KAFKA-329-DRAFT-v2.patch
        33 kB
        Prashanth Menon
      3. KAFKA-329-DRAFT.patch
        29 kB
        Prashanth Menon

        Activity

        Prashanth Menon made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Fix Version/s 0.8 [ 12317244 ]
        Resolution Fixed [ 1 ]
        Prashanth Menon made changes -
        Attachment KAFKA-329-v1.patch [ 12531899 ]
        Prashanth Menon made changes -
        Attachment KAFKA-329-DRAFT-v2.patch [ 12531762 ]
        Prashanth Menon made changes -
        Attachment KAFKA-329-DRAFT.patch [ 12531626 ]
        Prashanth Menon made changes -
        Assignee Prashanth Menon [ prashanth.menon ]
        Neha Narkhede made changes -
        Field Original Value New Value
        Parent KAFKA-47 [ 12514684 ]
        Issue Type Bug [ 1 ] Sub-task [ 7 ]
        Neha Narkhede created issue -

          People

          • Assignee:
            Prashanth Menon
            Reporter:
            Neha Narkhede
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development