[ARROW-2626] [Python] pandas ArrowInvalid message should include failing column name

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.10.0
• Component/s: Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/19023
• Assignee: Louis Potok
• Reporter: Louis Potok
• Created: 22/May/18 00:15
• Updated: 11/Jan/23 07:22
• Resolved: 12/Jun/18 20:29

Description

When writing a pandas dataframe to feather using its to_feather method, sometimes a single column's conversion fails in pandas_compat.convert_column, which leads the whole method to fail. The error message should include the name of the column that failed for easier debugging.

 

Eg instead of:

 

ArrowInvalid: Error converting from Python objects to String/UTF8: Got Python object of type int but can only handle these types: str, bytes.
 

Throw:

ArrowInvalid: Error converting from Python objects to String/UTF8: Got Python object of type int but can only handle these types: str, bytes. (column "user_id")

 

Originally opened on Github Issues: https://github.com/apache/arrow/issues/2072

Issue Links

• links to: GitHub Pull Request #2075