[FLINK-4808] Allow skipping failed checkpoints

• Type: New Feature
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Affects Version/s: 1.1.2, 1.1.3
• Component/s: Runtime / Checkpointing
• Labels: auto-deprioritized-major auto-deprioritized-minor
• Assignee: Unassigned
• Reporter: Stephan Ewen
• Created: 12/Oct/16 08:51
• Updated: 06/Feb/22 10:37

Description

Currently, if Flink cannot complete a checkpoint, it results in a failure and recovery.

To make the impact of less stable storage infrastructure on the performance of Flink less severe, Flink should be able to tolerate a certain number of failed checkpoints and simply keep executing.

This should be controllable via a parameter, for example:

env.getCheckpointConfig().setAllowedFailedCheckpoints(3);

A value of -1 could indicate an infinite number of checkpoint failures tolerated by Flink.
The default value should still be 0, to keep compatibility with the existing behavior.

Sub-Tasks

• Operators should tolerate checkpoint failures: Closed
• Checkpoint Coordinator should fail ExecutionGraph after "n" unsuccessful checkpoints: Closed
• Checkpoint Overview should list failed checkpoints: Open