[FLINK-3296] DataStream.write*() methods are not flushing properly

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.0.0
• Component/s: Connectors / Common
• Assignee: Robert Metzger
• Reporter: Robert Metzger
• Created: 28/Jan/16 11:22
• Updated: 12/Jan/18 02:26
• Resolved: 16/Feb/16 14:53

Description

The DataStream.write() methods rely on the FileSinkFunctionByMillis class, which has a logic for flushing records, even though the underlying stream is never flushed. This is misleading for users as files are not written as they would expect it.

The code was initial written with FileOutputFormats in mind, but the types were not set correctly. This PR opened the write() method to any output format: https://github.com/apache/flink/pull/706/files

Issue Links

• links to: GitHub Pull Request #1563