[KAFKA-5296] Unable to write to some partitions of newly created topic in 10.2

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.10.2.0
• Assignee: Unassigned
• Reporter: Abhisek Saikia
• Created: 20/May/17 01:24
• Updated: 13/Sep/17 10:45
• Resolved: 13/Sep/17 10:45

Description

We are using kafka 10.2 and the cluster was running fine for a month with 50 topics and now we are having issue in producing message by creating new topics. The create topic command is successful but producers are throwing error while writing to some partitions.

Error in producer-
java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Expiring 1 record(s) for [topic1]-8: 30039 ms has passed since batch creation plus linger time
at org.apache.kafka.clients.producer.internals.FutureRecordMetadata.valueOrError(FutureRecordMetadata.java:70) ~[kafka-clients-0.10.2.0.jar:na]
at org.apache.kafka.clients.producer.internals.FutureRecordMetadata.get(FutureRecordMetadata.java:57) ~[kafka-clients-0.10.2.0.jar:na]
at org.apache.kafka.clients.producer.internals.FutureRecordMetadata.get(FutureRecordMetadata.java:25) ~[kafka-clients-0.10.2.0.jar:na]

On the broker side, I don't see any topic-parition folder getting created for the broker who is the leader for the partition.

While using 0.8 client, the write used to hang while it starts writing to the partition having this issue. With 10.2 it resolved the the producer hang issue

Issue Links

• is related to: KAFKA-5027 Kafka Controller Redesign