[FLINK-21090] Add E2E/ITCase test for checkpoints after tasks finished

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Fix Version/s: 1.14.0
• Component/s: API / DataStream, Runtime / Checkpointing
• Labels: pull-request-available
• Assignee: Roman Khachatryan
• Reporter: Yun Gao
• Created: 22/Jan/21 04:01
• Updated: 08/Oct/21 10:05
• Resolved: 03/Sep/21 10:42

Description

We should write an E2e test for the feature. The corner cases should include:

• must check for committing side effects (notifyCheckpointComplete() was called)
• BroadcastState
• both non keyed followed by keyed exchanges?
• aligned/unaligned checkpoints? (with unaligned checkpoint keyed operators/subtasks can be partially finished, which is very very rare in aligned checkpoints) - maybe it’s good enough to test only unaligned checkpoints.

Issue Links

• causes: FLINK-24331 PartiallyFinishedSourcesITCase fails with "No downstream received 0 from xxx;"
• is blocked by: FLINK-23808 Bypass operators when advanceToEndOfEventTime for both legacy and new source tasks
• is blocked by: FLINK-13973 Checkpoint recovery failed after user set uidHash
• is blocked by: FLINK-23811 Handle finished subtasks in CommonTestUtils.waitForAllTaskRunning
• links to: GitHub Pull Request #16735
• links to: GitHub Pull Request #16773
• links to: GitHub Pull Request #17062