Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Won't Fix
-
0.15.0
-
None
-
python 3.7
Description
PyArrow cant serialize pandas `IntegerArray` and return this error below:
SerializationCallbackError: pyarrow does not know how to serialize objects of type <class 'pandas.core.arrays.integer.IntegerArray'>.
To reproduce this bug just run this bunch of code
import pandas as pd import pyarrow as pa from pandas.core.arrays.integer import IntegerArray int_array = pd.array([1, None, 3], dtype=pd.Int32Dtype()) pa.default_serialization_context().serialize(int_array).to_buffer().to_pybytes()