Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
From https://github.com/apache/arrow/issues/4168. We should add support for pandas' nullable Integer extension dtypes, as those could map nicely to arrows integer types.
Ideally this happens in a generic way though, and not specific for this extension type, which is discussed in ARROW-5271
Attachments
Issue Links
- blocks
-
SPARK-30966 spark.createDataFrame fails with pandas DataFrame including pandas.NA
- Resolved
- duplicates
-
ARROW-7002 Support pandas nullable integer type Int64
- Closed
- is blocked by
-
ARROW-2428 [Python] Add API to map Arrow types (including extension types) to pandas ExtensionArray instances for to_pandas conversions
- Resolved
-
ARROW-3829 [Python] Support protocols to extract Arrow objects from third-party classes
- Resolved
-
ARROW-5271 [Python] Interface for converting pandas ExtensionArray / other custom array objects to pyarrow Array
- Closed