[FLINK-18450] FLIP-182: Support watermark alignment

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.15.0
• Component/s: API / DataStream, Connectors / Common
• Labels: auto-unassigned
• Assignee: Unassigned
• Reporter: Jiangjie Qin
• Created: 30/Jun/20 00:21
• Updated: 07/Apr/22 10:30
• Resolved: 07/Apr/22 10:19

Description

With the per-split watermark support, SourceReaderBase should be able to perform watermark alignment so that all the connectors that inherit from it would benefit.

Issue Links

• is related to: FLINK-27117 FLIP-217: Support watermark alignment of source splits

Sub-Tasks

• Introduce CoordinatorStore: Closed
• Announce and combine latest watermarks across SourceReaders: Closed
• Block SourceReader when watermarks are out of alignment: Closed
• Support idleness with watermark alignment: Closed
• Add WatermarkStrategy#withWatermarkAlignment: Closed
• Document watermark alignment: Closed