[AVRO-798] add checksums to Snappy codec

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.1
• Component/s: java, spec
• Assignee: Doug Cutting
• Reporter: Doug Cutting
• Created: 06/Apr/11 22:09
• Updated: 06/May/11 19:14
• Resolved: 19/Apr/11 20:52

Description

A checksum might be included with each compressed block to better detect errors. While some filesystems (e.g. HDFS) may checksum data, not all do. Data files may also accumulate errors when copied between filesystems. For back-compatibility, we cannot easily add checksums to existing data files, but a new codec provides us with the opportunity to do this.

Issue Links

• relates to: AVRO-788 add Snappy compression