Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-3399

[Python] Cannot serialize numpy matrix object

    XMLWordPrintableJSON

Details

    Description

      This is a regression from 0.9.0 and happens with 0.10.0 with Python 3.6.5 on Linux.

      from pyarrow import plasma
      import numpy
      import time
      import subprocess
      import os
      import signal
      
      m = numpy.matrix(numpy.array([[1, 2], [3, 4]]))
      
      process = subprocess.Popen(['plasma_store', '-m', '1000000', '-s', '/tmp/plasma', '-d', '/dev/shm'], stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, encoding='utf8', preexec_fn=os.setpgrp)
      time.sleep(5)
      client = plasma.connect('/tmp/plasma', '', 0)
      
      try:
          client.put(m)
      finally:
          client.disconnect()
          os.killpg(os.getpgid(process.pid), signal.SIGTERM)
      

      Error:

        File "pyarrow/_plasma.pyx", line 397, in pyarrow._plasma.PlasmaClient.put
        File "pyarrow/serialization.pxi", line 338, in pyarrow.lib.serialize
        File "pyarrow/error.pxi", line 89, in pyarrow.lib.check_status
      pyarrow.lib.ArrowNotImplementedError: This object exceeds the maximum recursion depth. It may contain itself recursively.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              mitar Mitar
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3h 10m
                  3h 10m