Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-9636

[Python] Update documentation about 'LZO' compression in parquet.write_table

    XMLWordPrintableJSON

Details

    Description

      Hi,

      When trying to use 'LZO' codec in `pyarrow.parquet.write_table()` with below code, I get an error message indicating that 'LZO' is not available. However, this codec is mentioned as available in the doc [https://arrow.apache.org/docs/python/generated/pyarrow.parquet.write_table.html].

       

      Code

      
      from pyarrow import parquet as pq
      
      pq.write_table(data, file, compression='LZO')
      

       

      Error message

       File "pyarrow/_parquet.pyx", line 1374, in pyarrow._parquet.ParquetWriter.write_table
      
      File "pyarrow/error.pxi", line 99, in pyarrow.lib.check_status
      
      OSError: Codec type LZO not supported in Parquet format
      
      

       

      I would suggest correcting the documentation, or making this codec available?

      Thanks for your support.

      Bests,

       

      Attachments

        Issue Links

          Activity

            People

              arw2019 Andrew Wieteska
              Yohplala Pierre
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m