Kafka
  1. Kafka
  2. KAFKA-1196

java.lang.IllegalArgumentException Buffer.limit on FetchResponse.scala + 33

    Details

    • Type: Bug Bug
    • Status: Patch Available
    • Priority: Blocker Blocker
    • Resolution: Unresolved
    • Affects Version/s: 0.8.0
    • Fix Version/s: 0.9.0
    • Component/s: consumer
    • Labels:
    • Environment:
      running java 1.7, linux and kafka compiled against scala 2.9.2

      Description

      I have 6 topics each with 8 partitions spread over 4 kafka servers.
      the servers are 24 core 72 gig ram.

      While consuming from the topics I get an IlegalArgumentException and all consumption stops, the error keeps on throwing.

      I've tracked it down to FectchResponse.scala line 33

      The error happens when the FetchResponsePartitionData object's readFrom method calls:
      messageSetBuffer.limit(messageSetSize)

      I put in some debug code the the messageSetSize is 671758648, while the buffer.capacity() gives 155733313, for some reason the buffer is smaller than the required message size.

      I don't know the consumer code enough to debug this. It doesn't matter if compression is used or not.

      1. KAFKA-1196.patch
        13 kB
        Ewen Cheslack-Postava

        Activity

          People

          • Assignee:
            Ewen Cheslack-Postava
            Reporter:
            Gerrit Jansen van Vuuren
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:

              Development