Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-6115

[Python] support LargeList, LargeString, LargeBinary in conversion to pandas

    XMLWordPrintableJSON

Details

    Description

      General python support for those 3 new types has been added: ARROW-6000, ARROW-6084

      However, one aspect that is not yet implemented is conversion to pandas (or numpy array):

      In [67]: a = pa.array(['a', 'b', 'c'], pa.large_string()) 
      
      In [68]: a.to_pandas() 
      ...
      ArrowNotImplementedError: large_utf8
      
      In [69]: pa.table({'a': a}).to_pandas()
      ...
      ArrowNotImplementedError: No known equivalent Pandas block for Arrow data of type large_string is known.
      

      Attachments

        Issue Links

          Activity

            People

              jorisvandenbossche Joris Van den Bossche
              jorisvandenbossche Joris Van den Bossche
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m