Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-1196

java.lang.IllegalArgumentException Buffer.limit on FetchResponse.scala + 33

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 0.8.0
    • 0.10.1.0
    • consumer
    • running java 1.7, linux and kafka compiled against scala 2.9.2

    Description

      I have 6 topics each with 8 partitions spread over 4 kafka servers.
      the servers are 24 core 72 gig ram.

      While consuming from the topics I get an IlegalArgumentException and all consumption stops, the error keeps on throwing.

      I've tracked it down to FectchResponse.scala line 33

      The error happens when the FetchResponsePartitionData object's readFrom method calls:
      messageSetBuffer.limit(messageSetSize)

      I put in some debug code the the messageSetSize is 671758648, while the buffer.capacity() gives 155733313, for some reason the buffer is smaller than the required message size.

      I don't know the consumer code enough to debug this. It doesn't matter if compression is used or not.

      Attachments

        1. KAFKA-1196.patch
          13 kB
          Ewen Cheslack-Postava

        Issue Links

          Activity

            People

              ewencp Ewen Cheslack-Postava
              gerritjvv Gerrit Jansen van Vuuren
              Votes:
              1 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: