[KAFKA-4238] consumer-subscription not working, when accessing a newly created topic immediately after its creation with the AdminUtils

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.10.0.0, 0.10.0.1
• Component/s: admin, consumer
• Assignee: Unassigned
• Reporter: Florian Witteler
• Created: 30/Sep/16 13:05
• Updated: 03/Aug/18 18:09

Description

I created a test-project to reproduce the bug.
https://github.com/FloWi/kafka-topic-creation-bug

We use a docker container that creates a fresh topic before a testsuite gets executed (see trait FreshKafkaTopics). That trait uses the AdminUtils to create the topic.

If we access the newly created topic directly after its creation, the subscriber is broken. It sometimes works though (<5%), so it seems to be a race-condition.

If I put a Thread.sleep(1000) after the topic-creation, everything's fine though.

So, the problem is twofold:

• AdminUtils.createTopic should block until the topic-creation is completed
• new KafkaConsumer[String, String](props).subscribe(util.Arrays.asList(topic)) should throw an exception, when the topic is "not ready"