[KAFKA-12343] Recent change to use SharedTopicAdmin in KakfkaBasedLog fails with AK 0.10.x brokers

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.5.2, 2.8.0, 2.7.1, 2.6.2
• Fix Version/s: 2.5.2, 2.8.0, 2.7.1, 2.6.2
• Component/s: connect
• Assignee: Randall Hauch
• Reporter: Randall Hauch
• Reviewer: Konstantine Karantasis
• Created: 18/Feb/21 20:15
• Updated: 20/Feb/21 00:35
• Resolved: 20/Feb/21 00:35

Description

System test failure (sample):

Java.lang.Exception: UnsupportedVersionException: MetadataRequest versions older than 4 don't support the allowAutoTopicCreation field
        at org.apache.kafka.clients.admin.KafkaAdminClient$Call.fail(KafkaAdminClient.java:755)
        at org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.handleResponses(KafkaAdminClient.java:1136)
        at org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.processRequests(KafkaAdminClient.java:1301)
        at org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.run(KafkaAdminClient.java:1224)
        at java.lang.Thread.run(Thread.java:748)
[2021-02-16 12:05:11,735] ERROR [Worker clientId=connect-1, groupId=connect-cluster] Uncaught exception in herder work thread, exiting:  (org.apache.kafka.connect.runtime.distributed.Di
stributedHerder)
org.apache.kafka.connect.errors.ConnectException: API to get the get the end offsets for topic 'connect-offsets' is unsupported on brokers at worker25:9092
        at org.apache.kafka.connect.util.TopicAdmin.endOffsets(TopicAdmin.java:680)
        at org.apache.kafka.connect.util.KafkaBasedLog.readToLogEnd(KafkaBasedLog.java:338)
        at org.apache.kafka.connect.util.KafkaBasedLog.start(KafkaBasedLog.java:195)
        at org.apache.kafka.connect.storage.KafkaOffsetBackingStore.start(KafkaOffsetBackingStore.java:136)
        at org.apache.kafka.connect.runtime.Worker.start(Worker.java:197)
        at org.apache.kafka.connect.runtime.AbstractHerder.startServices(AbstractHerder.java:128)
        at org.apache.kafka.connect.runtime.distributed.DistributedHerder.run(DistributedHerder.java:311)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.UnsupportedVersionException: MetadataRequest versions older than 4 don't support the allowAutoTopicCre
ation field
        at org.apache.kafka.common.internals.KafkaFutureImpl.wrapAndThrow(KafkaFutureImpl.java:45)
        at org.apache.kafka.common.internals.KafkaFutureImpl.access$000(KafkaFutureImpl.java:32)
        at org.apache.kafka.common.internals.KafkaFutureImpl$SingleWaiter.await(KafkaFutureImpl.java:89)
        at org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:260)
        at org.apache.kafka.connect.util.TopicAdmin.endOffsets(TopicAdmin.java:668)
        ... 11 more       

Issue Links

• links to: GitHub Pull Request #10158