[FLINK-25857] Add committer metrics to track the status of committables

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.19.0
• Component/s: Connectors / Common
• Labels: pull-request-available

Release Note

The TwoPhaseCommittingSink.createCommitter method parametrization has been changed, a new CommitterInitContext parameter has been added.

The original method will remain available during the 1.19 release line, but they will be removed in consecutive releases.

When migrating please also consider changes introduced by FLINK-33973 and FLIP-372 (https://cwiki.apache.org/confluence/display/FLINK/FLIP-372%3A+Enhance+and+synchronize+Sink+API+to+match+the+Source+API)

• Assignee: Peter Vary
• Reporter: Fabian Paul
• Created: 27/Jan/22 13:11
• Updated: 31/Jan/24 12:49
• Resolved: 12/Dec/23 13:41

Description

With Sink V2 we can now track the progress of a committable during committing and show metrics about the committing status. (i.e. failed, retried, succeeded).

The voted FLIP https://cwiki.apache.org/confluence/display/FLINK/FLIP-371%3A+Provide+initialization+context+for+Committer+creation+in+TwoPhaseCommittingSink

Issue Links

• causes: FLINK-33568 SinkV2MetricsITCase.testCommitterMetrics fails with NullPointerException
• causes: FLINK-33635 Some connectors can not compile in 1.19-SNAPSHOT
• links to: GitHub Pull Request #23555
• links to: GitHub Pull Request #23876