Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-1642

[Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 0.8.2.0
    • 0.8.2.0
    • producer
    • None

    Description

      I see my CPU spike to 100% when network connection is lost for while. It seems network IO thread are very busy logging following error message. Is this expected behavior ?
      2014-09-17 14:06:16.830 [kafka-producer-network-thread] ERROR org.apache.kafka.clients.producer.internals.Sender - Uncaught error in kafka producer I/O thread:

      java.lang.IllegalStateException: No entry found for node -2

      at org.apache.kafka.clients.ClusterConnectionStates.nodeState(ClusterConnectionStates.java:110)

      at org.apache.kafka.clients.ClusterConnectionStates.disconnected(ClusterConnectionStates.java:99)

      at org.apache.kafka.clients.NetworkClient.initiateConnect(NetworkClient.java:394)

      at org.apache.kafka.clients.NetworkClient.maybeUpdateMetadata(NetworkClient.java:380)

      at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:174)

      at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:175)

      at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:115)

      at java.lang.Thread.run(Thread.java:744)

      Thanks,

      Bhavesh

      Attachments

        1. KAFKA-1642.patch
          13 kB
          Ewen Cheslack-Postava
        2. KAFKA-1642.patch
          5 kB
          Ewen Cheslack-Postava
        3. KAFKA-1642_2015-01-05_18:56:55.patch
          8 kB
          Ewen Cheslack-Postava
        4. KAFKA-1642_2014-10-23_16:19:41.patch
          25 kB
          Ewen Cheslack-Postava
        5. KAFKA-1642_2014-10-20_17:33:57.patch
          22 kB
          Ewen Cheslack-Postava
        6. 0001-Initial-CPU-Hish-Usage-by-Kafka-FIX-and-Also-fix-CLO.patch
          20 kB
          Bhavesh Mistry

        Activity

          People

            ewencp Ewen Cheslack-Postava
            Bmis13 Bhavesh Mistry
            Jun Rao Jun Rao
            Votes:
            2 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: