Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3789

Upgrade Snappy to fix snappy decompression errors

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 0.10.0.0
    • 0.10.0.1
    • core
    • None

    Description

      snappy-java recently fixed a bug where parsing the MAGIC HEADER was being handled incorrectly: https://github.com/xerial/snappy-java/issues/142

      This issue caused "unknown broker exceptions" in the clients and prevented these messages from being appended to the log when messages were written using snappy c bindings in clients like librdkafka or ruby-kafka and read using snappy-java in the broker.

      The related librdkafka issue is here: https://github.com/edenhill/librdkafka/issues/645

      I am able to regularly reproduce the issue with librdkafka in 0.10 and after upgrading snappy-java to 1.1.2.6 the issue is resolved.

      Attachments

        Issue Links

          Activity

            People

              granthenke Grant Henke
              granthenke Grant Henke
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: