[FLINK-19359] Restore from Checkpoint fails if checkpoint folders is corrupt/partial

• Type: Improvement
• Status: Reopened
• Priority: Not a Priority
• Resolution: Unresolved
• Affects Version/s: 1.8.0
• Component/s: Runtime / Checkpointing
• Assignee: Unassigned
• Reporter: Arpith Prakash
• Created: 22/Sep/20 11:16
• Updated: 29/Jul/21 07:37

Description

I'm using Flink 1.8.0 version and have enabled externalized checkpoint to hdfs location, we have seen few scenarios where checkpoint folders will have checkpoint files but only missing "_metadata" file. If we attempt to restore application from this path, application fails with exception "Could not find _metadata file. There is similar discussion in Flink user mailing list with subject  "Zookeeper connection loss causing checkpoint corruption" around it. I've attached sample snapshot on how folder structure looks as well.