[FLINK-29977] Kafka connector not compatible with kafka-clients 3.3x

• Type: Technical Debt
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.16.0
• Component/s: Connectors / Kafka
• Labels: pull-request-available
• Assignee: Chesnay Schepler
• Reporter: Chesnay Schepler
• Created: 10/Nov/22 09:30
• Updated: 27/Jul/23 09:11
• Resolved: 27/Jul/23 09:11

Description

In https://github.com/apache/kafka/commit/3ea7b418fb3d7e9fc74c27751c1b02b04877f197 the TransactionManager was modified and no longer has a topicPartitionBookkeeper that we access via reflection.

The TopicPartitionBookkeeper was refactored to a TxnPartitionMap class.
The reset method we require is still present though; so this could potentially be fixed by just falling back to another field name if required.

Issue Links

• duplicates: FLINK-29978 FlinkKafkaInternalProducer not compatible with kafka-clients-3.3.x
• Is contained by: FLINK-31599 Update Kafka dependency in flink-connector-kafka to 3.4.0
• links to: GitHub Pull Request #21313