Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-5859

[Python] Support ExtentionType on conversion to numpy/pandas

    XMLWordPrintableJSON

    Details

      Description

      Currently converting a Table of RecordBatch with an ExtensionType array to pandas gives:

      ArrowNotImplementedError: No known equivalent Pandas block for Arrow data of type extension<arrow.py_extension_type> is known.
      

      And similarly converting the array itself to a python object (to_pandas or to_pylist) gives an ArrowNotImplementedError or a "KeyError: 28"

      Initial support could be to fall back to the storage type.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jorisvandenbossche Joris Van den Bossche
                Reporter:
                jorisvandenbossche Joris Van den Bossche
              • Votes:
                1 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1.5h
                  1.5h