Description
ZooKeeper mode is going to be deprecated in Apache Kafka 4.0. Connect currently uses an EmbeddedKafkaCluster (that depends on an EmbeddedZookeeper) for integration tests with the EmbeddedConnectCluster. This should be migrated to remove the ZooKeeper dependency, instead working in the KRaft mode (probably with co-located brokers and controllers). We could potentially leverage the existing test kit for KRaft clusters which handles a bunch of stuff including the listeners configuration setup, formatting the metadata log directory, allowing usage of non-static random ports for `controller.quorum.voters`, initialization of the shared server(s), broker(s), and controller(s) etc.
One more thing to note is that some Connect integration tests currently use the `kafka.security.authorizer.AclAuthorizer` which requires ZooKeeper. These tests should be migrated to use the new authorizer from KIP-801 if we want to completely eliminate the dependency on ZooKeeper.
Attachments
Issue Links
- blocks
-
KAFKA-17611 Remove ZK from Kafka 4.0
-
- Open
-
- relates to
-
KAFKA-14572
Migrate EmbeddedKafkaCluster used by Streams integration tests from EmbeddedZookeeper to KRaft
-
- Resolved
-
- links to