[FLINK-18602] Support specific offset for topic list for kafka connector

• Type: Improvement
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Affects Version/s: 1.11.0
• Component/s: Connectors / Kafka, Table SQL / Ecosystem
• Labels: auto-deprioritized-major auto-deprioritized-minor auto-unassigned
• Assignee: Unassigned
• Reporter: Shengkai Fang
• Created: 15/Jul/20 03:53
• Updated: 21/Dec/21 10:39

Description

During FLINK-18449, we decide to support topic discovery for kafka connector in table api. However, we can only use format 'partition:0,offset:42;partition:1,offset:300' to specify the offset for single topic. I think the better format is 'topic:topic-1,partition:0,offset:42;topic:topic-2,partition:1,offset:300' in topic discovery situation.
 
 
 
 

 

Issue Links

• Blocked: FLINK-18449 Make topic discovery and partition discovery configurable for FlinkKafkaConsumer in Table API