Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3789

Upgrade Snappy to fix snappy decompression errors

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.10.0.0
    • Fix Version/s: 0.10.0.1
    • Component/s: core
    • Labels:
      None

      Description

      snappy-java recently fixed a bug where parsing the MAGIC HEADER was being handled incorrectly: https://github.com/xerial/snappy-java/issues/142

      This issue caused "unknown broker exceptions" in the clients and prevented these messages from being appended to the log when messages were written using snappy c bindings in clients like librdkafka or ruby-kafka and read using snappy-java in the broker.

      The related librdkafka issue is here: https://github.com/edenhill/librdkafka/issues/645

      I am able to regularly reproduce the issue with librdkafka in 0.10 and after upgrading snappy-java to 1.1.2.6 the issue is resolved.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                granthenke Grant Henke
                Reporter:
                granthenke Grant Henke
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: