[FLINK-9325] generate the _meta file for checkpoint only when the writing is truly successful

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Abandoned
• Affects Version/s: 1.5.0
• Component/s: Runtime / State Backends
• Labels: pull-request-available
• Assignee: Sihua Zhou
• Reporter: Sihua Zhou
• Created: 09/May/18 16:31
• Updated: 09/Dec/21 07:30
• Resolved: 30/Jan/19 09:56

Description

We should generate the _meta file for checkpoint only when the writing is totally successful. We should write the metadata file first to a temp file and then atomically rename it (with an equivalent workaround for S3).

Issue Links

• blocks: FLINK-9043 Introduce a friendly way to resume the job from externalized checkpoints automatically
• relates to: FLINK-17808 Rename checkpoint meta file to "_metadata" until it has completed writing
• links to: GitHub Pull Request #5982
• links to: GitHub Pull Request #5982