[FLINK-31363] KafkaSink failed to commit transactions under EXACTLY_ONCE semantics

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.17.0, 1.16.1, 1.18.0
• Fix Version/s: kafka-3.0.0
• Component/s: Connectors / Kafka
• Labels: pull-request-available
• Assignee: Tzu-Li (Gordon) Tai
• Reporter: lightzhao
• Created: 08/Mar/23 02:55
• Updated: 12/Apr/23 17:13
• Resolved: 12/Apr/23 17:13

Description

When KafkaSink starts Exactly once and no data is written to the topic during a checkpoint, the transaction commit exception is triggered, with the following exception.

[Transiting to fatal error state due to org.apache.kafka.common.errors.InvalidTxnStateException: The producer attempted a transactional operation in an invalid state.]

Issue Links

• links to: GitHub Pull Request #15
• links to: GitHub Pull Request #22126