[FLINK-29977] Kafka connector not compatible with kafka-clients 3.3x

• Type: Technical Debt
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.16.0
• Component/s: Connectors / Kafka
• Labels: pull-request-available
• Assignee: Chesnay Schepler
• Reporter: Chesnay Schepler
• Created: 10/Nov/22 09:30
• Updated: 14/Nov/22 08:35

Description

In https://github.com/apache/kafka/commit/3ea7b418fb3d7e9fc74c27751c1b02b04877f197 the TransactionManager was modified and no longer has a topicPartitionBookkeeper that we access via reflection.

The TopicPartitionBookkeeper was refactored to a TxnPartitionMap class.
The reset method we require is still present though; so this could potentially be fixed by just falling back to another field name if required.

Issue Links

• duplicates: FLINK-29978 FlinkKafkaInternalProducer not compatible with kafka-clients-3.3.x
• links to: GitHub Pull Request #21313