[PARQUET-1242] parquet.thrift refers to wrong releases for the new compressions

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: format-2.5.0
• Assignee: Zoltan Ivanfi
• Reporter: Zoltan Ivanfi
• Created: 09/Mar/18 10:59
• Updated: 18/Apr/18 12:22
• Resolved: 23/Mar/18 13:56

Description

parquet.thrift contains the following:

/**
 * Supported compression algorithms.
 *
 * Codecs added in 2.3.2 can be read by readers based on 2.3.2 and later.
 * Codec support may vary between readers based on the format version and
 * libraries available at runtime. Gzip, Snappy, and LZ4 codecs are
 * widely available, while Zstd and Brotli require additional libraries.
 */
enum CompressionCodec {
  UNCOMPRESSED = 0;
  SNAPPY = 1;
  GZIP = 2;
  LZO = 3;
  BROTLI = 4; // Added in 2.3.2
  LZ4 = 5; // Added in 2.3.2
  ZSTD = 6; // Added in 2.3.2
}

In reality, there was no 2.3.2 release. These compression codecs were added in version 2.4.

Issue Links

• blocks: PARQUET-1234 Release Parquet format 2.5.0
• links to: GitHub Pull Request #87