[FLINK-17627] Add support for writing _SUCCESS file with StreamingFileSink

• Type: Improvement
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Component/s: Connectors / FileSystem
• Labels: auto-deprioritized-major auto-deprioritized-minor usability
• Assignee: Unassigned
• Reporter: Robert Metzger
• Created: 12/May/20 07:35
• Updated: 14/Nov/21 22:38

Description

(Note: This feature has been requested by multiple users: https://lists.apache.org/list.html?[e-mail]:lte=10000M:_SUCCESS)

Hadoop Map Reduce is writing a _SUCCESS file to output directories once the result has been completely written.
Users migrating from Hadoop MR to Flink want to have a similar behavior in Flinks StreamingFileSink.

Issue Links

• is related to: FLINK-17587 Filesystem streaming sink support partition commit (success file)