Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-2626

[Python] pandas ArrowInvalid message should include failing column name

    Details

      Description

      When writing a pandas dataframe to feather using its to_feather method, sometimes a single column's conversion fails in pandas_compat.convert_column, which leads the whole method to fail. The error message should include the name of the column that failed for easier debugging.

       

      Eg instead of:

       

      ArrowInvalid: Error converting from Python objects to String/UTF8: Got Python object of type int but can only handle these types: str, bytes.
       
      

      Throw:

      ArrowInvalid: Error converting from Python objects to String/UTF8: Got Python object of type int but can only handle these types: str, bytes. (column "user_id")
      
      

       

      Originally opened on Github Issues: https://github.com/apache/arrow/issues/2072

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                louispotok Louis Potok
                Reporter:
                louispotok Louis Potok
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m