[FLINK-10807] KafkaConsumer still consume removed topic after changing topics list

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.6.2
• Component/s: Connectors / Kafka
• Assignee: Jiayi Liao
• Reporter: Jiayi Liao
• Created: 07/Nov/18 07:20
• Updated: 14/Feb/19 16:05
• Resolved: 14/Feb/19 16:05

Description

subscribedPartitionsToStartOffsets in KafkaConsumerBase is getting values from restoredState, which is initialized in initializeState and discovering partitions. However, if we remove a topic in topics list and restore the Flink program, the restoredState still keeps removed topic, and the fetcher still fetches the data of the removed topic.

Issue Links

• duplicates: FLINK-10342 Kafka duplicate topic consumption when topic name is changed