[ARROW-5379] [Python] support pandas' nullable Integer type in from_pandas

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Component/s: Python
• External issue URL: https://github.com/apache/arrow/issues/21838
• Assignee: Unassigned
• Reporter: Joris Van den Bossche
• Created: 20/May/19 18:55
• Updated: 11/Jan/23 07:40
• Resolved: 12/Mar/20 08:55

Description

From https://github.com/apache/arrow/issues/4168. We should add support for pandas' nullable Integer extension dtypes, as those could map nicely to arrows integer types.

Ideally this happens in a generic way though, and not specific for this extension type, which is discussed in ARROW-5271

Issue Links

• blocks: SPARK-30966 spark.createDataFrame fails with pandas DataFrame including pandas.NA
• duplicates: ARROW-7002 Support pandas nullable integer type Int64
• is blocked by: ARROW-2428 [Python] Add API to map Arrow types (including extension types) to pandas ExtensionArray instances for to_pandas conversions
• is blocked by: ARROW-3829 [Python] Support protocols to extract Arrow objects from third-party classes
• is blocked by: ARROW-5271 [Python] Interface for converting pandas ExtensionArray / other custom array objects to pyarrow Array