[ARROW-1731] [Python] Provide for selecting a subset of columns to convert in RecordBatch/Table.from_pandas

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.10.0
• Component/s: Python
• Labels: beginner pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/15614
• Assignee: Antoine Pitrou
• Reporter: Wes McKinney
• Created: 25/Oct/17 19:00
• Updated: 11/Jan/23 07:16
• Resolved: 23/Apr/18 12:46

Description

Currently it's all-or-nothing, and to do the subsetting in pandas incurs a data copy. This would enable columns (by name or index) to be selected out without additional data copying. We should add a columns= argument to the the from_pandas calls and do the subsetting when we dispatch the individual arrays for conversion to Arrow.

cc cpcloud jreback

Issue Links

• incorporates: ARROW-1388 [Python] Add Table.drop method for removing columns
• links to: GitHub Pull Request #1924