Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-2570

[Python] Add support for writing parquet files with LZ4 compression

    XMLWordPrintableJSON

    Details

      Description

      import pyarrow as pa
      import pyarrow.parquet as pq
      
      data = [pa.array([None])]
      batch = pa.RecordBatch.from_arrays(data, ['x'])
      table = pa.Table.from_batches([batch])
      pq.write_table(table, "test.parquet", compression='LZ4')

      currently fails with

      Traceback (most recent call last):
       File "_parquet.pyx", line 811, in pyarrow._parquet.check_compression_name
      pyarrow.lib.ArrowException: Unsupported compression: LZ4

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                veprbl Dmitry Kalinkin
                Reporter:
                veprbl Dmitry Kalinkin
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 10m
                  1h 10m