[FLINK-31588] The unaligned checkpoint type is wrong at subtask level

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.16.0, 1.17.0
• Fix Version/s: 1.16.2, 1.18.0, 1.17.1
• Component/s: Runtime / Checkpointing
• Labels: pull-request-available
• Assignee: Rui Fan
• Reporter: Rui Fan
• Created: 23/Mar/23 10:45
• Updated: 25/Apr/23 02:23
• Resolved: 25/Apr/23 02:23

Description

FLINK-20488 supported show checkpoint type for each subtask, and it based on received `CheckpointOptions` and it's right.

However, FLINK-27251 supported timeout aligned to unaligned checkpoint barrier in the output buffers. It means the received `CheckpointOptions` can be converted from aligned checkpoint to unaligned checkpoint.

So, the unaligned checkpoint type may be wrong at subtask level. For example, as shown in the figure below, Unaligned checkpoint type is false, but it is actually Unaligned checkpoint (persisted data > 0).

 

 

Issue Links

• is caused by: FLINK-27251 Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask
• is related to: FLINK-27251 Timeout aligned to unaligned checkpoint barrier in the output buffers of an upstream subtask
• relates to: FLINK-31864 Generate unaligned checkpoint type based on persisted data
• links to: GitHub Pull Request #22392
• links to: GitHub Pull Request #22453
• links to: GitHub Pull Request #22454