[ARROW-9177] [C++][Parquet] Tracking issue for cross-implementation LZ4 Parquet compression compatibility

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: C++
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/25281
• Assignee: Antoine Pitrou
• Reporter: Wes McKinney
• Created: 18/Jun/20 20:12
• Updated: 11/Jan/23 08:05
• Resolved: 23/Sep/20 20:06

Description

per PARQUET-1878, it seems that there are still problems with our use of LZ4 compression in the Parquet format. While we should fix this (the Parquet specification and our implementation of it), we may need to disable use of LZ4 compression until the appropriate compatibility testing can bed one.

Issue Links

• fixes: PARQUET-1878 [C++] lz4 codec is not compatible with Hadoop Lz4Codec
• is related to: PARQUET-2196 Support LZ4_RAW codec
• relates to: ARROW-11301 [C++] Fix reading LZ4-compressed Parquet files produced by Java Parquet implementation
• links to: GitHub Pull Request #16
• links to: GitHub Pull Request #9244

Sub-Tasks

• [C++][Parquet] Disable writing files with LZ4 codec: Resolved