[ARROW-2106] [Python] pyarrow.array can't take a pandas Series of python datetime objects.

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.8.0
• Fix Version/s: 0.9.0
• Component/s: Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/18078
• Assignee: Uwe Korn
• Reporter: Naveen Michaud-Agrawal
• Created: 07/Feb/18 00:51
• Updated: 11/Jan/23 07:18
• Resolved: 12/Feb/18 05:42

Description

> import pyarrow
> from datetime import datetime
> import pandas
> dt = pandas.Series([datetime(2017, 12, 1), datetime(2017, 12, 3), datetime(2017, 12, 15)], dtype=object)
> pyarrow.array(dt, from_pandas=True)

Raises following:

---------------------------------------------------------------------------
ArrowInvalid Traceback (most recent call last)
<ipython-input-8-0d49f7fc5c49> in <module>()
----> 1 pyarrow.array(dt, from_pandas=True)

array.pxi in pyarrow.lib.array()

array.pxi in pyarrow.lib._ndarray_to_array()

error.pxi in pyarrow.lib.check_status()

ArrowInvalid: Error inferring Arrow type for Python object array. Got Python object of type datetime but can only handle these types: string, bool, float, int, date, time, decimal, list, array

As far as I can tell, the issue seems to be the call to PyDate_CheckExact here (instead of using PyDate_Check):

https://github.com/apache/arrow/blob/3098c1411930259070efb571fb350304b18ddc70/cpp/src/arrow/python/numpy_to_arrow.cc#L1005

Issue Links

• links to: GitHub Pull Request #1585