Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-2128

[Python] Cannot serialize array of empty lists

    XMLWordPrintableJSON

Details

    Description

      This currently failing:

      data = pd.Series([[], [], []])
      arr = pa.array(data)
      _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
      array.pxi:181: in pyarrow.lib.array
      ???
      array.pxi:26: in pyarrow.lib._sequence_to_array
      ???
      _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
      
      > ???
      E pyarrow.lib.ArrowTypeError: Unable to determine data type
      
      

      The code in SeqVisitor::GetType suggests that we don't want to support thus but I would have expected that the above should result in List<Null>.

      Attachments

        Issue Links

          Activity

            People

              uwe Uwe Korn
              uwe Uwe Korn
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: