Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-5296

Unable to write to some partitions of newly created topic in 10.2

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.2.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      We are using kafka 10.2 and the cluster was running fine for a month with 50 topics and now we are having issue in producing message by creating new topics. The create topic command is successful but producers are throwing error while writing to some partitions.

      Error in producer-
      java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Expiring 1 record(s) for [topic1]-8: 30039 ms has passed since batch creation plus linger time
      at org.apache.kafka.clients.producer.internals.FutureRecordMetadata.valueOrError(FutureRecordMetadata.java:70) ~[kafka-clients-0.10.2.0.jar:na]
      at org.apache.kafka.clients.producer.internals.FutureRecordMetadata.get(FutureRecordMetadata.java:57) ~[kafka-clients-0.10.2.0.jar:na]
      at org.apache.kafka.clients.producer.internals.FutureRecordMetadata.get(FutureRecordMetadata.java:25) ~[kafka-clients-0.10.2.0.jar:na]

      On the broker side, I don't see any topic-parition folder getting created for the broker who is the leader for the partition.

      While using 0.8 client, the write used to hang while it starts writing to the partition having this issue. With 10.2 it resolved the the producer hang issue

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                asaikia Abhisek Saikia
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: