Uploaded image for project: 'Apache Avro'
  1. Apache Avro
  2. AVRO-1142

Specification is misleading in regards to CRC32 checksum of Snappy blocks

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.7.2
    • Component/s: spec
    • Labels:
      None

      Description

      The specification says:

      Each compressed block is followed by its 4-byte, big-endian CRC32 checksum.

      This, in my opinion, suggests that the CRC32 checksum is calculated from the compressed block, when in fact it is computed from the block before compression (as it is implemented in java). I've implemented a snappy codec for C++ and had trouble with this

        Attachments

        1. AVRO-1142.patch
          0.6 kB
          Doug Cutting

          Activity

            People

            • Assignee:
              cutting Doug Cutting
              Reporter:
              mnagy Martin Nagy
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: