[KAFKA-3071] Kafka Server 0.8.2 ERROR OOME with siz

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Auto Closed
• Affects Version/s: 0.8.2.0
• Component/s: build
• Labels: build
• Environment: Linux ********* 2.6.32-431.23.3.el6.x86_64 #1 SMP Wed Jul 16 06:12:23 EDT 2014 x86_64 x86_64 x86_64 GNU/Linux
• Flags: Important
• Assignee: Unassigned
• Reporter: vijay bhaskar
• Reviewer: Ismael Juma
• Created: 06/Jan/16 19:48
• Updated: 30/Oct/17 11:41
• Resolved: 30/Oct/17 11:41

Description

[2016-01-06 12:34:18.819-0700] INFO Truncating log hughes-order-status-73 to offset 18. (kafka.log.Log)
[2016-01-06 12:34:18.819-0700] INFO Truncating log troubleshoot-completed-125 to offset 3. (kafka.log.Log)
[2016-01-06 12:34:19.064-0700] DEBUG Scheduling task highwatermark-checkpoint with initial delay 0 ms and period 5000 ms. (kafka.utils.KafkaScheduler)
[2016-01-06 12:34:19.106-0700] DEBUG Scheduling task [__consumer_offsets,0] with initial delay 0 ms and period -1 ms. (kafka.utils.KafkaScheduler)
[2016-01-06 12:34:19.106-0700] INFO Loading offsets from [__consumer_offsets,0] (kafka.server.OffsetManager)
[2016-01-06 12:34:19.108-0700] INFO Finished loading offsets from [__consumer_offsets,0] in 2 milliseconds. (kafka.server.OffsetManager)
[2016-01-06 12:34:27.023-0700] ERROR OOME with size 743364196 (kafka.network.BoundedByteBufferReceive)
java.lang.OutOfMemoryError: Java heap space
at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
at java.nio.ByteBuffer.allocate(ByteBuffer.java:331)
at kafka.network.BoundedByteBufferReceive.byteBufferAllocate(BoundedByteBufferReceive.scala:80)
at kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:63)
at kafka.network.Receive$class.readCompletely(Transmission.scala:56)
at kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29)
at kafka.network.BlockingChannel.receive(BlockingChannel.scala:108)
at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:72)
at kafka.consumer.SimpleConsumer.kafka$consumer$SimpleConsumer$$sendRequest(SimpleConsumer.scala:69)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(SimpleConsumer.scala:113)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply(SimpleConsumer.scala:113)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply(SimpleConsumer.scala:113)
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply$mcV$sp(SimpleConsumer.scala:112)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:112)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:112)
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33)
at kafka.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:111)
at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:97)
at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:89)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60)

[2016-01-06 12:34:32.003-0700] ERROR OOME with size 743364196 (kafka.network.BoundedByteBufferReceive)
java.lang.OutOfMemoryError: Java heap space
at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
at java.nio.ByteBuffer.allocate(ByteBuffer.java:331)
at kafka.network.BoundedByteBufferReceive.byteBufferAllocate(BoundedByteBufferReceive.scala:80)
at kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:63)
at kafka.network.Receive$class.readCompletely(Transmission.scala:56)
at kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29)
at kafka.network.BlockingChannel.receive(BlockingChannel.scala:108)
at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:80)
at kafka.consumer.SimpleConsumer.kafka$consumer$SimpleConsumer$$sendRequest(SimpleConsumer.scala:69)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(SimpleConsumer.scala:113)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply(SimpleConsumer.scala:113)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply(SimpleConsumer.scala:113)
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply$mcV$sp(SimpleConsumer.scala:112)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:112)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:112)
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33)
at kafka.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:111)
at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:97)
at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:89)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60)
[2016-01-06 12:34:34.994-0700] ERROR OOME with size 743364196 (kafka.network.BoundedByteBufferReceive)
java.lang.OutOfMemoryError: Java heap space
[2016-01-06 12:34:37.389-0700] ERROR OOME with size 750116719 (kafka.network.BoundedByteBufferReceive)
java.lang.OutOfMemoryError: Java heap space
[2016-01-06 12:34:37.433-0700] INFO re-registering broker info in ZK for broker 2 (kafka.server.KafkaHealthcheck)
[2016-01-06 12:34:37.438-0700] INFO done re-registering broker (kafka.server.KafkaHealthcheck)
[2016-01-06 12:34:37.439-0700] INFO Subscribing to /brokers/topics path to watch for new topics (kafka.server.KafkaHealthcheck)
[2016-01-06 12:34:37.510-0700] INFO New leader is 1 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
[2016-01-06 12:34:40.185-0700] ERROR OOME with size 743364196 (kafka.network.BoundedByteBufferReceive)
java.lang.OutOfMemoryError: Java heap space