[FLINK-4975] Add a limit for how much data may be buffered during checkpoint alignment

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.3
• Fix Version/s: 1.1.4, 1.2.0
• Component/s: Runtime / State Backends
• Assignee: Stephan Ewen
• Reporter: Stephan Ewen
• Created: 31/Oct/16 16:45
• Updated: 02/Dec/16 14:33
• Resolved: 08/Nov/16 23:14

Description

During checkpoint alignment, data may be buffered/spilled.

We should introduce an upper limit for the spilled data volume. After exceeding that limit, the checkpoint alignment should abort and the checkpoint be canceled.

Issue Links

• is blocked by: FLINK-4976 Add a way to abort in flight checkpoints
• is duplicated by: FLINK-4904 Add a limit for how much data may be spilled in checkpoint alignments
• links to: GitHub Pull Request #2754
• links to: GitHub Pull Request #2773