[KAFKA-528] IndexOutOfBoundsException thrown by kafka.consumer.ConsumerFetcherThread

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.8.0
• Fix Version/s: 0.8.0
• Labels: bugs
• Assignee: Jun Rao
• Reporter: John Fung
• Created: 24/Sep/12 21:49
• Updated: 29/Sep/12 18:19
• Resolved: 29/Sep/12 18:19

Description

1. Attached file system_test_1348521165.tar.gz contains all the associated log files for this test session.

2. The system test output log can be found at: system_test_1348521165/system_test_output.log

3. The following log message can be found at: system_test_1348521165/logs/console_consumer-5/console_consumer.log

[2012-09-24 14:15:12,016] ERROR [ConsumerFetcherThread-console-consumer-16186_jfung-1348521311426-2c83ced7-0-1], Error due to (kafka.consumer.ConsumerFetcherThread)

java.lang.IndexOutOfBoundsException

at java.nio.Buffer.checkIndex(Buffer.java:512)

at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:121)

at kafka.message.Message.magic(Message.scala:119)

at kafka.message.Message.checksum(Message.scala:132)

at kafka.message.Message.isValid(Message.scala:144)

at kafka.message.ByteBufferMessageSet$$anon$1.makeNextOuter(ByteBufferMessageSet.scala:118)

at kafka.message.ByteBufferMessageSet$$anon$1.makeNext(ByteBufferMessageSet.scala:149)

at kafka.message.ByteBufferMessageSet$$anon$1.makeNext(ByteBufferMessageSet.scala:89)

at kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:61)

at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:53)

at kafka.message.ByteBufferMessageSet.shallowValidBytes(ByteBufferMessageSet.scala:54)

at kafka.message.ByteBufferMessageSet.validBytes(ByteBufferMessageSet.scala:49)

at kafka.consumer.PartitionTopicInfo.enqueue(PartitionTopicInfo.scala:54)

at kafka.consumer.ConsumerFetcherThread.processPartitionData(ConsumerFetcherThread.scala:42)

at kafka.server.AbstractFetcherThread$$anonfun$doWork$5.apply(AbstractFetcherThread.scala:103)

at kafka.server.AbstractFetcherThread$$anonfun$doWork$5.apply(AbstractFetcherThread.scala:96)

at scala.collection.immutable.Map$Map2.foreach(Map.scala:127)

at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:96)

at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:50)