[FLINK-16369] Allow the StreamingFileSink to restore from a previous (old) savepoint.

• Type: New Feature
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Affects Version/s: 1.11.0
• Component/s: Connectors / FileSystem
• Labels: auto-deprioritized-major auto-deprioritized-minor
• Assignee: Unassigned
• Reporter: Kostas Kloudas
• Created: 02/Mar/20 08:57
• Updated: 18/Nov/21 10:39

Description

Currently the StreamingFileSink will fail upon recovery if the "in-progress" temporary file is not there anymore. This can happen either because of an error (someone deleted the file) or because the file was eventually committed after the savepoint was taken and is when we try to restore, it is in the FINALIZED state.

This issue will track the progress of alleviating this limitation.