[ARROW-17192] [Python] Pass **kwargs in read_feather to to_pandas()

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 11.0.0
• Component/s: Python
• Labels: pull-request-available
• Environment: Any environment
• External issue URL: https://github.com/apache/arrow/issues/32486
• Assignee: Alenka Frim
• Reporter: Adrien Pacifico
• Created: 23/Jul/22 20:45
• Updated: 11/Jan/23 11:49
• Resolved: 14/Nov/22 07:43

Description

A feather file with a column containing dates lower than 1677 or greater than 2262 cannot be read with pandas, du to  `.to_pandas` method.

To reproduce the issue:

### create feather file
import pandas as pd
from datetime import datetime
df = pd.DataFrame({"date": [
datetime.fromisoformat("1654-01-01"),
datetime.fromisoformat("1920-01-01"),
],})
df.to_feather("to_trash.feather")

### read feather file      
from pyarrow.feather import read_feather
read_feather("to_trash.feather")

 

I think that the expected behavior would be to have an object column contining datetime objects.

I think that the problem comes from _array_like_to_pandas method :
https://github.com/apache/arrow/blob/76f45a6892b13391fdede4c72934f75f6d56143c/python/pyarrow/array.pxi#L1584

or  from `_to_pandas()`
https://github.com/apache/arrow/blob/76f45a6892b13391fdede4c72934f75f6d56143c/python/pyarrow/array.pxi#L2742

or from `to_pandas`:
https://github.com/apache/arrow/blob/76f45a6892b13391fdede4c72934f75f6d56143c/python/pyarrow/array.pxi#L673

Issue Links

• links to: GitHub Pull Request #14492