[FLINK-23541] Call StreamOperator#finish on EndOfData

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.14.0
• Component/s: Runtime / Checkpointing
• Labels: pull-request-available
• Assignee: Dawid Wysakowicz
• Reporter: Dawid Wysakowicz
• Created: 29/Jul/21 08:06
• Updated: 11/Aug/21 07:25
• Resolved: 10/Aug/21 06:35

Description

We want to be able to bring the entire topology with a single checkpoint/savepoint. In order to do that we must be able to call finish on all operators before such a checkpoint is triggered. The idea is to emit EndOfData, which once received, triggers finish()/endInput(). After such a sequence we can trigger a checkpoint/savepoint which meets the aforementioned criteria.

Issue Links

• is blocked by: FLINK-23648 Drop StreamTwoInputProcessor in favour of StreamMultipleInputProcessor
• links to: GitHub Pull Request #16589
• links to: GitHub Pull Request #16761