Critical Description
With regex subscription like
consumer.subscribe("topic*")
The partition assignment is automatically done at the Kafka side, while there are some use cases where consumers want regex subscriptions but not Kafka-side partition assignment, rather with their own specific partition assignment. With ListTopics() they can periodically check for topic list changes and specifically subscribe to the partitions of the new topics.
For implementation, it involves sending a TopicMetadataRequest to a random broker and parse the response.
Attachments
Attachments
Issue Links
- blocks
-
KAFKA-1893 Allow regex subscriptions in the new consumer
-
- Resolved
-