Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-2278

[Python] deserializing Numpy struct arrays raises

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.8.0
    • None
    • Python

    Description

      >>> import numpy as np
      >>> dt = np.dtype([('x', np.int8), ('y', np.float32)])
      >>> arr = np.arange(5*10, dtype=np.int8).view(dt)
      >>> pa.deserialize(pa.serialize(arr).to_buffer())
      Traceback (most recent call last):
        File "<ipython-input-13-6810c780d033>", line 1, in <module>
          pa.deserialize(pa.serialize(arr).to_buffer())
        File "serialization.pxi", line 441, in pyarrow.lib.deserialize
        File "serialization.pxi", line 404, in pyarrow.lib.deserialize_from
        File "serialization.pxi", line 257, in pyarrow.lib.SerializedPyObject.deserialize
        File "serialization.pxi", line 174, in pyarrow.lib.SerializationContext._deserialize_callback
        File "/home/antoine/arrow/python/pyarrow/serialization.py", line 44, in _deserialize_numpy_array_list
          return np.array(data[0], dtype=np.dtype(data[1]))
      TypeError: a bytes-like object is required, not 'int'
      

      Attachments

        Issue Links

          Activity

            People

              Licht-T Licht Takeuchi
              apitrou Antoine Pitrou
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1.5h
                  1.5h