Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-748

Append to index fails due to invalid offset

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 0.8.0
    • Component/s: None
    • Labels:

      Description

      We seem to be appending to the index and it checks to make sure we do not insert an entry with an offset that is larger than the actual offset of the message. We seem to be trying to insert an offset = 1 in the index while lastOffset is 24463. This seems to get fixed on restarting the broker.

      java.lang.IllegalArgumentException: Attempt to append an offset (1) to position 21703 no larger than the last offset appended (24463).
      at kafka.log.OffsetIndex.append(OffsetIndex.scala:183)
      at kafka.log.LogSegment.append(LogSegment.scala:60)
      at kafka.log.Log.append(Log.scala:286)
      at kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:188)
      at kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:181)
      at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
      at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
      at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
      at scala.collection.TraversableLike$class.map(TraversableLike.scala:206)

        Attachments

        1. KAFKA-748-v1.patch
          6 kB
          Jay Kreps
        2. outindex
          699 kB
          Sriram Subramanian
        3. outmsg
          3.00 MB
          Sriram Subramanian

          Activity

            People

            • Assignee:
              jkreps Jay Kreps
              Reporter:
              sriramsub Sriram Subramanian
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: