[FLINK-28386] Trigger an immediate checkpoint after all tasks has reached end-of-data

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.18.0
• Component/s: Runtime / Checkpointing
• Labels: pull-request-available
• Assignee: Jiang Xin
• Reporter: Yun Gao
• Created: 05/Jul/22 06:25
• Updated: 23/Aug/23 09:41
• Resolved: 04/Jul/23 14:16

Description

Currently for bounded job in streaming mode, by default it will wait for one more checkpoint to commit the last piece of data. If the checkpoint period is long, the waiting time might also be long. to optimize this situation, we could eagerly trigger a checkpoint after tasks have reached end-of-data.

Issue Links

• causes: FLINK-32911 Release Testing: Verify FLINK-28386: Trigger an immediate checkpoint after all sinks finished
• causes: FLINK-32663 RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP
• causes: FLINK-32945 NullPointerException when executing TopSpeedWindowing example with checkpointing enabled
• duplicates: FLINK-31846 Support cancel final checkpoint when all tasks are finished
• links to: GitHub Pull Request #22670