[FLINK-8990] End-to-end test: Dynamic Kafka partition discovery

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: Connectors / Kafka, Tests
• Assignee: Tzu-Li (Gordon) Tai
• Reporter: Till Rohrmann
• Created: 16/Mar/18 12:42
• Updated: 18/Apr/18 12:14
• Resolved: 18/Apr/18 12:14

Description

We should add an end-to-end test which verifies the dynamic partition discovery of Flink's Kafka connector. We can simulate it by reading from a Kafka topic to which we add partitions after the job started. By writing to these new partitions it should be verifiable whether Flink noticed them by checking the output for completeness.

Issue Links

• links to: GitHub Pull Request #5779