Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3071

Kafka Server 0.8.2 ERROR OOME with siz

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Auto Closed
    • Affects Version/s: 0.8.2.0
    • Fix Version/s: None
    • Component/s: build
    • Labels:
    • Environment:
      Linux ********* 2.6.32-431.23.3.el6.x86_64 #1 SMP Wed Jul 16 06:12:23 EDT 2014 x86_64 x86_64 x86_64 GNU/Linux
    • Flags:
      Important

      Description

      [2016-01-06 12:34:18.819-0700] INFO Truncating log hughes-order-status-73 to offset 18. (kafka.log.Log)
      [2016-01-06 12:34:18.819-0700] INFO Truncating log troubleshoot-completed-125 to offset 3. (kafka.log.Log)
      [2016-01-06 12:34:19.064-0700] DEBUG Scheduling task highwatermark-checkpoint with initial delay 0 ms and period 5000 ms. (kafka.utils.KafkaScheduler)
      [2016-01-06 12:34:19.106-0700] DEBUG Scheduling task [__consumer_offsets,0] with initial delay 0 ms and period -1 ms. (kafka.utils.KafkaScheduler)
      [2016-01-06 12:34:19.106-0700] INFO Loading offsets from [__consumer_offsets,0] (kafka.server.OffsetManager)
      [2016-01-06 12:34:19.108-0700] INFO Finished loading offsets from [__consumer_offsets,0] in 2 milliseconds. (kafka.server.OffsetManager)
      [2016-01-06 12:34:27.023-0700] ERROR OOME with size 743364196 (kafka.network.BoundedByteBufferReceive)
      java.lang.OutOfMemoryError: Java heap space
      at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
      at java.nio.ByteBuffer.allocate(ByteBuffer.java:331)
      at kafka.network.BoundedByteBufferReceive.byteBufferAllocate(BoundedByteBufferReceive.scala:80)
      at kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:63)
      at kafka.network.Receive$class.readCompletely(Transmission.scala:56)
      at kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29)
      at kafka.network.BlockingChannel.receive(BlockingChannel.scala:108)
      at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:72)
      at kafka.consumer.SimpleConsumer.kafka$consumer$SimpleConsumer$$sendRequest(SimpleConsumer.scala:69)
      at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(SimpleConsumer.scala:113)
      at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply(SimpleConsumer.scala:113)
      at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply(SimpleConsumer.scala:113)
      at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33)
      at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply$mcV$sp(SimpleConsumer.scala:112)
      at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:112)
      at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:112)
      at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33)
      at kafka.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:111)
      at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:97)
      at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:89)
      at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60)

      [2016-01-06 12:34:32.003-0700] ERROR OOME with size 743364196 (kafka.network.BoundedByteBufferReceive)
      java.lang.OutOfMemoryError: Java heap space
      at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
      at java.nio.ByteBuffer.allocate(ByteBuffer.java:331)
      at kafka.network.BoundedByteBufferReceive.byteBufferAllocate(BoundedByteBufferReceive.scala:80)
      at kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:63)
      at kafka.network.Receive$class.readCompletely(Transmission.scala:56)
      at kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29)
      at kafka.network.BlockingChannel.receive(BlockingChannel.scala:108)
      at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:80)
      at kafka.consumer.SimpleConsumer.kafka$consumer$SimpleConsumer$$sendRequest(SimpleConsumer.scala:69)
      at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(SimpleConsumer.scala:113)
      at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply(SimpleConsumer.scala:113)
      at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply(SimpleConsumer.scala:113)
      at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33)
      at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply$mcV$sp(SimpleConsumer.scala:112)
      at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:112)
      at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:112)
      at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33)
      at kafka.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:111)
      at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:97)
      at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:89)
      at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60)
      [2016-01-06 12:34:34.994-0700] ERROR OOME with size 743364196 (kafka.network.BoundedByteBufferReceive)
      java.lang.OutOfMemoryError: Java heap space
      [2016-01-06 12:34:37.389-0700] ERROR OOME with size 750116719 (kafka.network.BoundedByteBufferReceive)
      java.lang.OutOfMemoryError: Java heap space
      [2016-01-06 12:34:37.433-0700] INFO re-registering broker info in ZK for broker 2 (kafka.server.KafkaHealthcheck)
      [2016-01-06 12:34:37.438-0700] INFO done re-registering broker (kafka.server.KafkaHealthcheck)
      [2016-01-06 12:34:37.439-0700] INFO Subscribing to /brokers/topics path to watch for new topics (kafka.server.KafkaHealthcheck)
      [2016-01-06 12:34:37.510-0700] INFO New leader is 1 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
      [2016-01-06 12:34:40.185-0700] ERROR OOME with size 743364196 (kafka.network.BoundedByteBufferReceive)
      java.lang.OutOfMemoryError: Java heap space

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              bhaskarv82@gmail.com vijay bhaskar
              Reviewer:
              Ismael Juma
            • Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 96h
                96h
                Remaining:
                Remaining Estimate - 96h
                96h
                Logged:
                Time Spent - Not Specified
                Not Specified