[ARROW-2706] [Python] pandas Timestamp not supported in ListArray

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.9.0
• Component/s: Python
• External issue URL: https://github.com/apache/arrow/issues/15732
• Assignee: Unassigned
• Reporter: Thomas Buhrmann
• Created: 13/Jun/18 10:18
• Updated: 11/Jan/23 07:22
• Resolved: 13/Jun/18 18:49

Description

It seems pandas Timestamps are supported in some places but not others. Specifically, they work in primitive Arrays but not ListArrays:

import pyarrow
from datetime import datetime

ts = [pd.Timestamp(2017, 1, 1, 12), pd.Timestamp(2018, 1, 1, 12)]
dt = [datetime(2017, 1, 1, 12), datetime(2018, 1, 1, 12)]

pyarrow.Table.from_pandas(pd.DataFrame(dict(dates=dt)))       # OK   :)
pyarrow.Table.from_pandas(pd.DataFrame(dict(dates=[dt, dt]))) # OK   :)
pyarrow.Table.from_pandas(pd.DataFrame(dict(dates=ts)))       # OK   :)
pyarrow.Table.from_pandas(pd.DataFrame(dict(dates=[ts, ts]))) # Fail :(

The above code results in: 

ArrowInvalid: Error inferring Arrow data type for collection of Python objects. Got Python object of type Timestamp but can only handle these types: bool, float, integer, date, datetime, bytes, unicode, decimal

 

I guess this should be supported?