[SPARK-26635] illegal hardware instruction

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Component/s: PySpark, Spark Core
• Assignee: Unassigned
• Reporter: Elchin
• Created: 16/Jan/19 08:55
• Updated: 16/Jan/19 08:57
• Resolved: 16/Jan/19 08:57

Description

I can't import pyarrow:

>>> import pyarrow as pa
[1]    31441 illegal hardware instruction (core dumped)  python3

The environment is:

Python 3.6.7
PySpark 2.4.0
PyArrow: 0.11.1
Pandas: 0.23.4
NumPy: 1.15.4
OS: Linux 4.15.0-43-generic #46-Ubuntu SMP Thu Dec 6 14:45:28 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux