[FLINK-16177] Integrate Operator Coordinators with Checkpoints

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.11.0
• Component/s: Runtime / Checkpointing
• Labels: pull-request-available
• Assignee: Stephan Ewen
• Reporter: Stephan Ewen
• Created: 19/Feb/20 15:52
• Updated: 16/Oct/20 10:33
• Resolved: 16/May/20 16:34

Description

The operator coordinators are stateful and hence need to store state in checkpoints.

See FLIP-27 for details on operator coordinators: https://cwiki.apache.org/confluence/display/FLINK/FLIP-27%3A+Refactor+Source+Interface

The initial implementation approach is to trigger coordinator checkpoints first, and when all coordinator checkpoints are done, then the source checkpoint barriers will be injected.

Note: This functionality will eventually replace the checkpoint master hooks.

Issue Links

• links to: GitHub Pull Request #11274
• links to: GitHub Pull Request #12137