Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-1326 New consumer checklist
  3. KAFKA-2275

Add a ListTopics() API to the new consumer

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.9.0.0
    • Component/s: consumer
    • Labels:
      None

      Description

      With regex subscription like

      consumer.subscribe("topic*")
      

      The partition assignment is automatically done at the Kafka side, while there are some use cases where consumers want regex subscriptions but not Kafka-side partition assignment, rather with their own specific partition assignment. With ListTopics() they can periodically check for topic list changes and specifically subscribe to the partitions of the new topics.

      For implementation, it involves sending a TopicMetadataRequest to a random broker and parse the response.

        Attachments

        1. KAFKA-2275_2015-07-17_21:39:27.patch
          14 kB
          Ashish Singh
        2. KAFKA-2275_2015-07-20_10:44:19.patch
          23 kB
          Ashish Singh
        3. KAFKA-2275_2015-07-22_16:09:34.patch
          24 kB
          Ashish Singh
        4. KAFKA-2275_2015-07-23_09:34:41.patch
          28 kB
          Ashish Singh
        5. KAFKA-2275.patch
          12 kB
          Ashish Singh
        6. KAFKA-2275.patch
          7 kB
          Ashish Singh

          Issue Links

            Activity

              People

              • Assignee:
                singhashish Ashish Singh
                Reporter:
                guozhang Guozhang Wang
                Reviewer:
                Guozhang Wang
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: