[FLINK-25706] Add idleness to Kafka Source documentation

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Component/s: Connectors / Kafka, Documentation
• Assignee: Martijn Visser
• Reporter: Martijn Visser
• Created: 19/Jan/22 14:54
• Updated: 09/Feb/22 08:11
• Resolved: 09/Feb/22 08:11

Description

All sources based on FLIP-27 do not go automatically in an idle state if the parallelism is higher than the number of partitions.

By accident, we introduced that behavior but now we corrected it so we have to clarify the documentation. The solution is either lowering the parallelism or using WatermarkStrategy#withIdleness

Issue Links

• is duplicated by: FLINK-25818 Add explanation how Kafka Source deals with idleness when parallelism is higher then the number of partitions