[FLINK-9334] Docs to have a code snippet of Kafka partition discovery

• Type: Improvement
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Component/s: Connectors / Kafka
• Labels: auto-deprioritized-major auto-deprioritized-minor auto-unassigned
• Assignee: Unassigned
• Reporter: Juho Autio
• Created: 11/May/18 08:19
• Updated: 30/Dec/21 10:39

Description

Tzu-Li (Gordon) said:

Yes, it might be helpful to have a code snippet to demonstrate the configuration for partition discovery.

 

---

Background
 
The docs correctly say:
 

To enable it, set a non-negative value for flink.partition-discovery.interval-millis in the provided properties config

 
So it should be set in the Properties that are passed in the constructor of FlinkKafkaConsumer.
 
I had somehow assumed that this should go to flink-conf.yaml (maybe because it starts with "flink."?), and obviously the FlinkKafkaConsumer doesn't read that.
 
A piece of example code might've helped me avoid this mistake. 
 
This was discussed on the user mailing list:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Kafka-Consumers-Partition-Discovery-doesn-t-work-tp19129p19484.html