Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-1642

[Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.8.2.0
    • Fix Version/s: 0.8.2.0
    • Component/s: producer
    • Labels:
      None

      Description

      I see my CPU spike to 100% when network connection is lost for while. It seems network IO thread are very busy logging following error message. Is this expected behavior ?
      2014-09-17 14:06:16.830 [kafka-producer-network-thread] ERROR org.apache.kafka.clients.producer.internals.Sender - Uncaught error in kafka producer I/O thread:

      java.lang.IllegalStateException: No entry found for node -2

      at org.apache.kafka.clients.ClusterConnectionStates.nodeState(ClusterConnectionStates.java:110)

      at org.apache.kafka.clients.ClusterConnectionStates.disconnected(ClusterConnectionStates.java:99)

      at org.apache.kafka.clients.NetworkClient.initiateConnect(NetworkClient.java:394)

      at org.apache.kafka.clients.NetworkClient.maybeUpdateMetadata(NetworkClient.java:380)

      at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:174)

      at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:175)

      at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:115)

      at java.lang.Thread.run(Thread.java:744)

      Thanks,

      Bhavesh

        Attachments

        1. KAFKA-1642.patch
          13 kB
          Ewen Cheslack-Postava
        2. KAFKA-1642.patch
          5 kB
          Ewen Cheslack-Postava
        3. KAFKA-1642_2015-01-05_18:56:55.patch
          8 kB
          Ewen Cheslack-Postava
        4. KAFKA-1642_2014-10-23_16:19:41.patch
          25 kB
          Ewen Cheslack-Postava
        5. KAFKA-1642_2014-10-20_17:33:57.patch
          22 kB
          Ewen Cheslack-Postava
        6. 0001-Initial-CPU-Hish-Usage-by-Kafka-FIX-and-Also-fix-CLO.patch
          20 kB
          Bhavesh Mistry

          Activity

            People

            • Assignee:
              ewencp Ewen Cheslack-Postava
              Reporter:
              Bmis13 Bhavesh Mistry
              Reviewer:
              Jun Rao
            • Votes:
              2 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: