Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-4111

[Python] Create time types from Python sequences of integers

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 0.14.0
    • Component/s: Python
    • Labels:
      None

      Description

      This works for dates, but not times:

      >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> traceback >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
      
          def test_to_pandas_deduplicate_date_time():
              nunique = 100
              repeats = 10
          
              unique_values = list(range(nunique))
          
              cases = [
                  # array type, to_pandas options
                  ('date32', {'date_as_object': True}),
                  ('date64', {'date_as_object': True}),
                  ('time32[ms]', {}),
                  ('time64[us]', {})
              ]
          
              for array_type, pandas_options in cases:
      >           arr = pa.array(unique_values * repeats, type=array_type)
      
      pyarrow/tests/test_convert_pandas.py:2392: 
      _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
      pyarrow/array.pxi:175: in pyarrow.lib.array
          return _sequence_to_array(obj, mask, size, type, pool, from_pandas)
      pyarrow/array.pxi:36: in pyarrow.lib._sequence_to_array
          check_status(ConvertPySequence(sequence, mask, options, &out))
      _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
      
      >   raise ArrowInvalid(message)
      E   pyarrow.lib.ArrowInvalid: ../src/arrow/python/python_to_arrow.cc:1012 : ../src/arrow/python/iterators.h:70 : Could not convert 0 with type int: converting to time32
      

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              wesmckinn Wes McKinney
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: