[FLINK-24065] Upgrade the TwoPhaseCommitSink to support empty transaction after finished

• Type: Sub-task
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.14.0
• Fix Version/s: 1.14.0
• Component/s: Connectors / Common, Runtime / Checkpointing
• Labels: pull-request-available
• Assignee: Yun Gao
• Reporter: Yun Gao
• Created: 31/Aug/21 06:26
• Updated: 13/Sep/21 02:42
• Resolved: 13/Sep/21 02:42

Description

In https://issues.apache.org/jira/browse/FLINK-23473 for the TwoPhaseCommitSink, we would not create new transactions after finished to avoid we have transactions left after job finished. However, since with the current implementation of the TwoPhaseCommitSink, we would have to write the transactions into the state for each checkpoint, and the state does not support null transaction now, thus there would be NullPointerException in this case.

Issue Links

• links to: GitHub Pull Request #17120
• links to: GitHub Pull Request #17231