[ARROW-2570] [Python] Add support for writing parquet files with LZ4 compression

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.10.0
• Component/s: Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/18937
• Assignee: Dmitry Kalinkin
• Reporter: Dmitry Kalinkin
• Created: 11/May/18 02:57
• Updated: 11/Jan/23 07:21
• Resolved: 11/May/18 10:44

Description

import pyarrow as pa
import pyarrow.parquet as pq

data = [pa.array([None])]
batch = pa.RecordBatch.from_arrays(data, ['x'])
table = pa.Table.from_batches([batch])
pq.write_table(table, "test.parquet", compression='LZ4')

currently fails with

Traceback (most recent call last):
 File "_parquet.pyx", line 811, in pyarrow._parquet.check_compression_name
pyarrow.lib.ArrowException: Unsupported compression: LZ4

Issue Links

• links to: GitHub Pull Request #2030