[KAFKA-3145] CPU Usage Spike to 100% when network connection is to error port

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: 0.8.2.1, 0.9.0.0
• Component/s: producer
• Assignee: Dong Lin
• Reporter: Zhiwei Peng
• Created: 25/Jan/16 10:33
• Updated: 12/Jul/18 22:22
• Resolved: 12/Jul/18 22:22

Description

CPU spike to 100% when network connection is to error port.
It seems network IO thread are very busy logging following error message.

[2016-01-25 14:09:12,476] ERROR Uncaught error in kafka producer I/O thread: (org.apache.kafka.clients.producer.internals.Sender)
java.lang.IllegalStateException: Invalid request (size = -1241382912)
at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:68)
at org.apache.kafka.common.network.Selector.poll(Selector.java:248)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
at java.lang.Thread.run(Thread.java:745)
[2016-01-25 14:09:12,479] ERROR Uncaught error in kafka producer I/O thread: (org.apache.kafka.clients.producer.internals.Sender)
java.lang.NullPointerException
at org.apache.kafka.common.network.NetworkReceive.complete(NetworkReceive.java:48)
at org.apache.kafka.common.network.Selector.poll(Selector.java:249)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
at java.lang.Thread.run(Thread.java:745)
[2016-01-25 14:09:12,480] ERROR Uncaught error in kafka producer I/O thread: (org.apache.kafka.clients.producer.internals.Sender)
java.lang.NullPointerException
at org.apache.kafka.common.network.NetworkReceive.complete(NetworkReceive.java:48)
at org.apache.kafka.common.network.Selector.poll(Selector.java:249)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
at java.lang.Thread.run(Thread.java:745)
[2016-01-25 14:09:12,480] ERROR Uncaught error in kafka producer I/O thread: (org.apache.kafka.clients.producer.internals.Sender)
java.lang.NullPointerException
at org.apache.kafka.common.network.NetworkReceive.complete(NetworkReceive.java:48)
at org.apache.kafka.common.network.Selector.poll(Selector.java:249)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
at java.lang.Thread.run(Thread.java:745)
[2016-01-25 14:09:12,481] ERROR Uncaught error in kafka producer I/O thread: (org.apache.kafka.clients.producer.internals.Sender)
java.lang.NullPointerException
at org.apache.kafka.common.network.NetworkReceive.complete(NetworkReceive.java:48)
at org.apache.kafka.common.network.Selector.poll(Selector.java:249)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
at java.lang.Thread.run(Thread.java:745)

Thanks,