[FLINK-19510] FLIP-143: Introduce a new unified sink api

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Fix Version/s: 1.12.0
• Component/s: API / DataStream
• Labels: pull-request-available
• Assignee: Guowei Ma
• Reporter: Guowei Ma
• Created: 06/Oct/20 08:34
• Updated: 24/Nov/20 10:44
• Resolved: 24/Nov/20 10:44

Description

As described in FLIP-143: https://cwiki.apache.org/confluence/display/FLINK/FLIP-143%3A+Unified+Sink+API we want to introduce a new unified sink api.

Issue Links

• links to: GitHub Pull Request #13971
• mentioned in: Page Loading...

Sub-Tasks

• Rename the `SinkTransformation` to `LegacySinkTransformation`: Closed
• Introduce new Sink API interfaces: Closed
• Implement writer operator for new Sink API: Closed
• Implement StreamCommitterOperator for new Sink API: Closed
• Implement Batch committer for the new API: Closed
• Implement the `SinkTransformation`: Closed
• Make the `GlobalCommitter` a standalone interface that does not extend the `Committer`: Closed
• Rename Sink API Writer interface to SinkWriter: Closed
• Make the TestSink reusable in all the sink related tests.: Closed
• Add SimpleVersionedSerializerTypeSerializerProxy: Closed
• Rename GlobalStreamingCommitterOperator to StreamingGlobalCommitterOperator: Closed
• Implement a new unified File Sink based on the new Sink API: Closed
• Add E2E tests for the new streaming case of the new FileSink: Closed
• Make SinkITCase stable: Closed
• Add the IOException to all the I/O related methods' signature in Sink API.: Closed
• Give SinkWriter access to processing-time service: Closed
• SinkTransformationTranslator fail to handle the PartitionTransformation: Closed
• Keep the UID of SinkWriter same as the SinkTransformation: Closed
• Make FileSink support processing time: Closed
• Add documentation about the FileSink: Closed
• Translation the FileSink Document into Chinese: Closed