[FLINK-10522] Check if RecoverableWriter supportsResume and act accordingly.

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.6.0
• Fix Version/s: 1.7.1, 1.8.0
• Component/s: Connectors / FileSystem
• Labels: pull-request-available
• Assignee: Kostas Kloudas
• Reporter: Kostas Kloudas
• Created: 10/Oct/18 09:59
• Updated: 05/Dec/18 14:15
• Resolved: 05/Dec/18 14:15

Description

So far we assumed that all `RecoverableWriters` support "resuming", i.e. after recovering from a failure or from a savepoint they could keep writing to the previously "in-progress" file. This assumption holds for all current writers, but in order to be able to accommodate also filesystems that may not support this operation, we should check upon initialization if the writer supports resuming and if yes, we go as before, if not, we recover for commit and commit the previously in-progress file.

Issue Links

• links to: GitHub Pull Request #7047