[FLINK-26304] GlobalCommitter can receive failed committables

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.14.3
• Fix Version/s: 1.14.4
• Component/s: API / DataStream, Connectors / Common
• Labels: pull-request-available
• Assignee: Fabian Paul
• Reporter: Fabian Paul
• Created: 22/Feb/22 15:50
• Updated: 23/Feb/22 18:14
• Resolved: 23/Feb/22 18:14

Description

After the introduction of retrying failed committables in the committer, it is important to only forward committables that have been committed to the GlobalCommitter. Currently, this is ignored and the Committer will forward all committable nevertheless if they succeeded. 

 

[1] https://github.com/apache/flink/blob/0a76d632f33d9a69df87457a63043bd7f609ed40/flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/sink/AbstractStreamingCommitterHandler.java#L144

Issue Links

• links to: GitHub Pull Request #18897