Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-15653

NPE in ChunkedByteStream

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.6.0
    • 3.7.0, 3.6.1
    • producer
    • None
    • Docker container on a Linux laptop, using the latest release.

    Description

      When looping franz-go integration tests, I received an UNKNOWN_SERVER_ERROR from producing. The broker logs for the failing request:

       

      [2023-10-19 22:29:58,160] ERROR [ReplicaManager broker=2] Error processing append operation on partition 2fa8995d8002fbfe68a96d783f26aa2c5efc15368bf44ed8f2ab7e24b41b9879-24 (kafka.server.ReplicaManager)
      java.lang.NullPointerException
      	at org.apache.kafka.common.utils.ChunkedBytesStream.<init>(ChunkedBytesStream.java:89)
      	at org.apache.kafka.common.record.CompressionType$3.wrapForInput(CompressionType.java:105)
      	at org.apache.kafka.common.record.DefaultRecordBatch.recordInputStream(DefaultRecordBatch.java:273)
      	at org.apache.kafka.common.record.DefaultRecordBatch.compressedIterator(DefaultRecordBatch.java:277)
      	at org.apache.kafka.common.record.DefaultRecordBatch.skipKeyValueIterator(DefaultRecordBatch.java:352)
      	at org.apache.kafka.storage.internals.log.LogValidator.validateMessagesAndAssignOffsetsCompressed(LogValidator.java:358)
      	at org.apache.kafka.storage.internals.log.LogValidator.validateMessagesAndAssignOffsets(LogValidator.java:165)
      	at kafka.log.UnifiedLog.append(UnifiedLog.scala:805)
      	at kafka.log.UnifiedLog.appendAsLeader(UnifiedLog.scala:719)
      	at kafka.cluster.Partition.$anonfun$appendRecordsToLeader$1(Partition.scala:1313)
      	at kafka.cluster.Partition.appendRecordsToLeader(Partition.scala:1301)
      	at kafka.server.ReplicaManager.$anonfun$appendToLocalLog$6(ReplicaManager.scala:1210)
      	at scala.collection.StrictOptimizedMapOps.map(StrictOptimizedMapOps.scala:28)
      	at scala.collection.StrictOptimizedMapOps.map$(StrictOptimizedMapOps.scala:27)
      	at scala.collection.mutable.HashMap.map(HashMap.scala:35)
      	at kafka.server.ReplicaManager.appendToLocalLog(ReplicaManager.scala:1198)
      	at kafka.server.ReplicaManager.appendEntries$1(ReplicaManager.scala:754)
      	at kafka.server.ReplicaManager.$anonfun$appendRecords$18(ReplicaManager.scala:874)
      	at kafka.server.ReplicaManager.$anonfun$appendRecords$18$adapted(ReplicaManager.scala:874)
      	at kafka.server.KafkaRequestHandler$.$anonfun$wrap$3(KafkaRequestHandler.scala:73)
      	at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:130)
      	at java.base/java.lang.Thread.run(Unknown Source)
      
      

      Attachments

        1. repro.sh
          4 kB
          Travis Bischel

        Issue Links

          Activity

            People

              jolshan Justine Olshan
              twmb Travis Bischel
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: