[ARROW-2459] pyarrow: Segfault with pyarrow.deserialize_pandas

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.10.0
• Component/s: Python
• Environment: OS X, Linux
• External issue URL: https://github.com/apache/arrow/issues/1884
• Assignee: Licht Takeuchi
• Reporter: Travis Brady
• Created: 14/Apr/18 01:13
• Updated: 11/Jan/23 07:21
• Resolved: 04/May/18 08:55

Description

Following up from https://github.com/apache/arrow/issues/1884 wherein I found that calling deserialize_pandas in the linked app.py script in the repo linked below causes the app.py process to segfault.

I initially observed this on OS X, but have since confirmed that the behavior exists on Linux as well.

Repo containing example: https://github.com/travisbrady/sanic-arrow 

And more generally: what is the right way to get a Java-based HTTP microservice to talk to a Python-based HTTP microservice using Arrow as the serialization format? I'm exchanging DataFrame type objects (they are pandas.DataFrame's on the Python side) between the two services for real-time scoring in a few xgboost models implemented in Python.