[ARROW-13108] [Python] Pyarrow 4.0.0 crashes upon import on macOS 10.13.6

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0, 4.0.1
• Fix Version/s: 5.0.0
• Component/s: Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/28811
• Assignee: Krisztian Szucs
• Reporter: Mark Keller
• Created: 17/Jun/21 20:29
• Updated: 11/Jan/23 08:31
• Resolved: 29/Jun/21 11:59

Description

Our Jenkins worker that we use for building `snowflake-connector-python` has the following setup:

 

$ uname -a
Darwin imac.local 17.7.0 Darwin Kernel Version 17.7.0: Fri Jul  6 19:54:51 PDT 2018; root:xnu-4570.71.3~2/RELEASE_X86_64 x86_64
$ python --version --version
Python 3.6.8 (v3.6.8:3c6b436a57, Dec 24 2018, 02:04:31) 
[GCC 4.2.1 Compatible Apple LLVM 6.0 (clang-600.0.57)]
$ pip list
Package    Version
---------- -------
Cython     0.29.23
numpy      1.19.5
pip        21.1.2
pyarrow    4.0.0
setuptools 57.0.0
wheel      0.36.2

This is in a completely new venv.

Then after installing these dependencies see the issue here:

$ python -c "import pyarrow"
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/Users/Shared/Jenkins/Home/workspace/BuildPyConnector-Mac/venv-36/lib/python3.6/site-packages/pyarrow/__init__.py", line 63, in <module>
    import pyarrow.lib as _lib
ImportError: dlopen(/Users/Shared/Jenkins/Home/workspace/BuildPyConnector-Mac/venv-36/lib/python3.6/site-packages/pyarrow/lib.cpython-36m-darwin.so, 2): Symbol not found: ____chkstk_darwin
  Referenced from: /Users/Shared/Jenkins/Home/workspace/BuildPyConnector-Mac/venv-36/lib/python3.6/site-packages/pyarrow/libarrow.400.dylib
  Expected in: /usr/lib/libSystem.B.dylib
 in /Users/Shared/Jenkins/Home/workspace/BuildPyConnector-Mac/venv-36/lib/python3.6/site-packages/pyarrow/libarrow.400.dylib

I'm sorry I'm not too sure what could be causing this, but please see what Uwe said here: https://github.com/snowflakedb/snowflake-connector-python/pull/762#issuecomment-863531840

 

I'd be happy to help you test a potential fix if you don't have a machine with such an old MacOS version

 

 

Issue Links

• links to: GitHub Pull Request #10587