Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-1196

java.lang.IllegalArgumentException Buffer.limit on FetchResponse.scala + 33

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 0.10.1.0
    • Component/s: consumer
    • Labels:
    • Environment:
      running java 1.7, linux and kafka compiled against scala 2.9.2

      Description

      I have 6 topics each with 8 partitions spread over 4 kafka servers.
      the servers are 24 core 72 gig ram.

      While consuming from the topics I get an IlegalArgumentException and all consumption stops, the error keeps on throwing.

      I've tracked it down to FectchResponse.scala line 33

      The error happens when the FetchResponsePartitionData object's readFrom method calls:
      messageSetBuffer.limit(messageSetSize)

      I put in some debug code the the messageSetSize is 671758648, while the buffer.capacity() gives 155733313, for some reason the buffer is smaller than the required message size.

      I don't know the consumer code enough to debug this. It doesn't matter if compression is used or not.

        Attachments

        1. KAFKA-1196.patch
          13 kB
          Ewen Cheslack-Postava

          Issue Links

            Activity

              People

              • Assignee:
                ewencp Ewen Cheslack-Postava
                Reporter:
                gerritjvv Gerrit Jansen van Vuuren
              • Votes:
                1 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: