[FLINK-7210] Add TwoPhaseCommitSinkFunction (implementing exactly-once semantic in generic way)

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.0
• Component/s: Connectors / Common
• Assignee: Piotr Nowojski
• Reporter: Piotr Nowojski
• Created: 17/Jul/17 09:20
• Updated: 07/Aug/17 07:20
• Resolved: 07/Aug/17 07:08

Description

To implement exactly-once sink there is a re-occurring pattern for doing it - two phase commit algorithm. It is used both in `BucketingSink` and in `Pravega` sink and it will be used in `Kafka 0.11` connector. It would be good to extract this common logic into one class, both to improve existing implementation (for exampe `Pravega`'s sink doesn't abort interrupted transactions) and to make it easier for the users to implement their own custom exactly-once sinks.

Issue Links

• links to: GitHub Pull Request #4368