Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-4111

[Python] Create time types from Python sequences of integers

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.15.0
    • Python

    Description

      This works for dates, but not times:

      >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> traceback >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
      
          def test_to_pandas_deduplicate_date_time():
              nunique = 100
              repeats = 10
          
              unique_values = list(range(nunique))
          
              cases = [
                  # array type, to_pandas options
                  ('date32', {'date_as_object': True}),
                  ('date64', {'date_as_object': True}),
                  ('time32[ms]', {}),
                  ('time64[us]', {})
              ]
          
              for array_type, pandas_options in cases:
      >           arr = pa.array(unique_values * repeats, type=array_type)
      
      pyarrow/tests/test_convert_pandas.py:2392: 
      _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
      pyarrow/array.pxi:175: in pyarrow.lib.array
          return _sequence_to_array(obj, mask, size, type, pool, from_pandas)
      pyarrow/array.pxi:36: in pyarrow.lib._sequence_to_array
          check_status(ConvertPySequence(sequence, mask, options, &out))
      _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
      
      >   raise ArrowInvalid(message)
      E   pyarrow.lib.ArrowInvalid: ../src/arrow/python/python_to_arrow.cc:1012 : ../src/arrow/python/iterators.h:70 : Could not convert 0 with type int: converting to time32
      

      Attachments

        Issue Links

          Activity

            People

              wesm Wes McKinney
              wesm Wes McKinney
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: