[ARROW-5436] [Python] expose filters argument in parquet.read_table

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.14.0
• Component/s: Python
• Labels: parquet pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/21889
• Assignee: Joris Van den Bossche
• Reporter: Joris Van den Bossche
• Created: 29/May/19 10:08
• Updated: 11/Jan/23 07:40
• Resolved: 06/Jun/19 15:36

Description

Currently, the parquet.read_table function can be used both for reading a single file (interface to ParquetFile) as a directory (interface to ParquetDataset).

ParquetDataset has some extra keywords such as filters that would be nice to expose through read_table as well.

Of course one can always use ParquetDataset if you need its power, but for pandas wrapping pyarrow it is easier to be able to pass through keywords just to parquet.read_table instead of calling either read_table or ParquetDataset. Context: https://github.com/pandas-dev/pandas/issues/26551

Issue Links

• is related to: ARROW-14772 [Python] unexpected content after groupby on a dataframe restored from partitioned parquet with filters
• links to: GitHub Pull Request #4409