Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Later
-
5.0.0
-
None
-
None
-
Platform: Red Hat Enterprise Linux 8.2 (Ootpa) - PPC64le
Python version: 3.6
PyArrow version: pyarrow - 5.0.0 - conda-forge/linux-ppc64le::pyarrow-5.0.0-py36h7a46c7e_8_cpu
Description
Description
The bug occurs when Installing the PyArrow library with Conda.
After trying to import with Python, this error shows up:
Illegal instruction (core dumped)
Environment
- Platform: Red Hat Enterprise Linux 8.2 (Ootpa) - PPC64le
- Python version: 3.6
- PyArrow version: pyarrow - 5.0.0 - conda-forge/linux-ppc64le::pyarrow-5.0.0-py36h7a46c7e_8_cpu
Steps to reproduce the bug
Installing with Conda and then trying to import the package through Python gives the error.
{{}}
conda create --name pyarrow_py36 python=3.6 conda activate pyarrow_py36 conda install pyarrow
{{}}
Tracebacks
conda create --name pyarrow_py36 python=3.6
Collecting package metadata (current_repodata.json): done Solving environment: done ==> WARNING: A newer version of conda exists. <== current version: 4.9.2 latest version: 4.10.3 Please update conda by running $ conda update -n base -c defaults conda ## Package Plan ## environment location: /p/home/gerryc/.conda/envs/pyarrow_py36 added / updated specs: - python=3.6 The following NEW packages will be INSTALLED: _libgcc_mutex conda-forge/linux-ppc64le::_libgcc_mutex-0.1-conda_forge _openmp_mutex conda-forge/linux-ppc64le::_openmp_mutex-4.5-1_gnu ca-certificates conda-forge/linux-ppc64le::ca-certificates-2021.10.8-h1084571_0 certifi pkgs/main/linux-ppc64le::certifi-2020.12.5-py36h6ffa863_0 ld_impl_linux-ppc~ conda-forge/linux-ppc64le::ld_impl_linux-ppc64le-2.36.1-ha35d02b_2 libffi conda-forge/linux-ppc64le::libffi-3.4.2-h3b9df90_4 libgcc-ng conda-forge/linux-ppc64le::libgcc-ng-11.2.0-h7698a5e_11 libgomp conda-forge/linux-ppc64le::libgomp-11.2.0-h7698a5e_11 libstdcxx-ng conda-forge/linux-ppc64le::libstdcxx-ng-11.2.0-habdf983_11 libzlib conda-forge/linux-ppc64le::libzlib-1.2.11-h339bb43_1013 ncurses conda-forge/linux-ppc64le::ncurses-6.2-hea85c5d_4 openssl conda-forge/linux-ppc64le::openssl-1.1.1l-h4e0d66e_0 pip conda-forge/noarch::pip-21.3-pyhd8ed1ab_0 python conda-forge/linux-ppc64le::python-3.6.13-h57873ef_2_cpython readline conda-forge/linux-ppc64le::readline-8.1-h5c45dff_0 setuptools pkgs/main/linux-ppc64le::setuptools-58.0.4-py36h6ffa863_0 sqlite conda-forge/linux-ppc64le::sqlite-3.36.0-h4e2196e_2 tk conda-forge/linux-ppc64le::tk-8.6.11-h41c6715_1 wheel conda-forge/noarch::wheel-0.37.0-pyhd8ed1ab_1 xz conda-forge/linux-ppc64le::xz-5.2.5-h6eb9509_1 zlib conda-forge/linux-ppc64le::zlib-1.2.11-h339bb43_1013 Proceed ([y]/n)? y Preparing transaction: done Verifying transaction: done Executing transaction: done # # To activate this environment, use # # $ conda activate pyarrow_py36 # # To deactivate an active environment, use # # $ conda deactivate
conda activate pyarrow_py36
conda install pyarrow
Collecting package metadata (current_repodata.json): done Solving environment: failed with initial frozen solve. Retrying with flexible solve. Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source. Collecting package metadata (repodata.json): done Solving environment: done ==> WARNING: A newer version of conda exists. <== current version: 4.9.2 latest version: 4.10.3 Please update conda by running $ conda update -n base -c defaults conda ## Package Plan ## environment location: /p/home/gerryc/.conda/envs/pyarrow_py36 added / updated specs: - pyarrow The following NEW packages will be INSTALLED: abseil-cpp conda-forge/linux-ppc64le::abseil-cpp-20210324.2-h3b9df90_0 arrow-cpp conda-forge/linux-ppc64le::arrow-cpp-5.0.0-py36hf9cf308_8_cpu aws-c-cal conda-forge/linux-ppc64le::aws-c-cal-0.5.11-hb3fac3d_0 aws-c-common conda-forge/linux-ppc64le::aws-c-common-0.6.2-h4e0d66e_0 aws-c-event-stream conda-forge/linux-ppc64le::aws-c-event-stream-0.2.7-h76da5f2_13 aws-c-io conda-forge/linux-ppc64le::aws-c-io-0.10.5-hf6a6c7c_0 aws-checksums conda-forge/linux-ppc64le::aws-checksums-0.1.11-hfe76d68_7 aws-sdk-cpp conda-forge/linux-ppc64le::aws-sdk-cpp-1.8.186-h90855e8_3 bzip2 conda-forge/linux-ppc64le::bzip2-1.0.8-h4e0d66e_4 c-ares conda-forge/linux-ppc64le::c-ares-1.17.2-h4e0d66e_0 gflags conda-forge/linux-ppc64le::gflags-2.2.2-hb209c28_1004 glog conda-forge/linux-ppc64le::glog-0.5.0-h4040248_0 grpc-cpp conda-forge/linux-ppc64le::grpc-cpp-1.40.0-h2bf711c_2 krb5 conda-forge/linux-ppc64le::krb5-1.19.2-haf43566_2 libblas conda-forge/linux-ppc64le::libblas-3.9.0-11_linuxppc64le_openblas libbrotlicommon conda-forge/linux-ppc64le::libbrotlicommon-1.0.9-h4e0d66e_5 libbrotlidec conda-forge/linux-ppc64le::libbrotlidec-1.0.9-h4e0d66e_5 libbrotlienc conda-forge/linux-ppc64le::libbrotlienc-1.0.9-h4e0d66e_5 libcblas conda-forge/linux-ppc64le::libcblas-3.9.0-11_linuxppc64le_openblas libcurl conda-forge/linux-ppc64le::libcurl-7.79.1-he415e40_1 libedit conda-forge/linux-ppc64le::libedit-3.1.20191231-h41a240f_2 libev conda-forge/linux-ppc64le::libev-4.33-h6eb9509_1 libevent conda-forge/linux-ppc64le::libevent-2.1.10-h97db324_4 libgfortran-ng conda-forge/linux-ppc64le::libgfortran-ng-11.2.0-hfdc3801_11 libgfortran5 conda-forge/linux-ppc64le::libgfortran5-11.2.0-he58fbb4_11 liblapack conda-forge/linux-ppc64le::liblapack-3.9.0-11_linuxppc64le_openblas libnghttp2 conda-forge/linux-ppc64le::libnghttp2-1.43.0-h42039ad_1 libopenblas conda-forge/linux-ppc64le::libopenblas-0.3.17-pthreads_h486567c_1 libprotobuf conda-forge/linux-ppc64le::libprotobuf-3.18.1-h690f14c_0 libssh2 conda-forge/linux-ppc64le::libssh2-1.10.0-ha5a9321_2 libthrift conda-forge/linux-ppc64le::libthrift-0.15.0-h54f692e_1 libutf8proc conda-forge/linux-ppc64le::libutf8proc-2.6.1-h4e0d66e_0 lz4-c conda-forge/linux-ppc64le::lz4-c-1.9.3-h3b9df90_1 numpy conda-forge/linux-ppc64le::numpy-1.19.5-py36h86665d4_1 orc conda-forge/linux-ppc64le::orc-1.7.0-hae6b4bd_0 parquet-cpp conda-forge/noarch::parquet-cpp-1.5.1-2 pyarrow conda-forge/linux-ppc64le::pyarrow-5.0.0-py36h7a46c7e_8_cpu python_abi conda-forge/linux-ppc64le::python_abi-3.6-2_cp36m re2 conda-forge/linux-ppc64le::re2-2021.09.01-h3b9df90_0 s2n conda-forge/linux-ppc64le::s2n-1.0.10-h97db324_0 snappy conda-forge/linux-ppc64le::snappy-1.1.8-hb209c28_3 zstd conda-forge/linux-ppc64le::zstd-1.5.0-h65c4b1a_0 The following packages will be UPDATED: certifi pkgs/main::certifi-2020.12.5-py36h6ff~ --> conda-forge::certifi-2021.5.30-py36h270354c_0 Proceed ([y]/n)? y Preparing transaction: done Verifying transaction: done Executing transaction: done
python
Python 3.6.13 | packaged by conda-forge | (default, Sep 23 2021, 07:37:44) [GCC 9.4.0] on linux Type "help", "copyright", "credits" or "license" for more information. >>> import pyarrow Illegal instruction (core dumped)
conda list
# packages in environment at /p/home/gerryc/.conda/envs/pyarrow_py36: # # Name Version Build Channel _libgcc_mutex 0.1 conda_forge conda-forge _openmp_mutex 4.5 1_gnu conda-forge abseil-cpp 20210324.2 h3b9df90_0 conda-forge arrow-cpp 5.0.0 py36hf9cf308_8_cpu conda-forge aws-c-cal 0.5.11 hb3fac3d_0 conda-forge aws-c-common 0.6.2 h4e0d66e_0 conda-forge aws-c-event-stream 0.2.7 h76da5f2_13 conda-forge aws-c-io 0.10.5 hf6a6c7c_0 conda-forge aws-checksums 0.1.11 hfe76d68_7 conda-forge aws-sdk-cpp 1.8.186 h90855e8_3 conda-forge bzip2 1.0.8 h4e0d66e_4 conda-forge c-ares 1.17.2 h4e0d66e_0 conda-forge ca-certificates 2021.10.8 h1084571_0 conda-forge certifi 2021.5.30 py36h270354c_0 conda-forge gflags 2.2.2 hb209c28_1004 conda-forge glog 0.5.0 h4040248_0 conda-forge grpc-cpp 1.40.0 h2bf711c_2 conda-forge krb5 1.19.2 haf43566_2 conda-forge ld_impl_linux-ppc64le 2.36.1 ha35d02b_2 conda-forge libblas 3.9.0 11_linuxppc64le_openblas conda-forge libbrotlicommon 1.0.9 h4e0d66e_5 conda-forge libbrotlidec 1.0.9 h4e0d66e_5 conda-forge libbrotlienc 1.0.9 h4e0d66e_5 conda-forge libcblas 3.9.0 11_linuxppc64le_openblas conda-forge libcurl 7.79.1 he415e40_1 conda-forge libedit 3.1.20191231 h41a240f_2 conda-forge libev 4.33 h6eb9509_1 conda-forge libevent 2.1.10 h97db324_4 conda-forge libffi 3.4.2 h3b9df90_4 conda-forge libgcc-ng 11.2.0 h7698a5e_11 conda-forge libgfortran-ng 11.2.0 hfdc3801_11 conda-forge libgfortran5 11.2.0 he58fbb4_11 conda-forge libgomp 11.2.0 h7698a5e_11 conda-forge liblapack 3.9.0 11_linuxppc64le_openblas conda-forge libnghttp2 1.43.0 h42039ad_1 conda-forge libopenblas 0.3.17 pthreads_h486567c_1 conda-forge libprotobuf 3.18.1 h690f14c_0 conda-forge libssh2 1.10.0 ha5a9321_2 conda-forge libstdcxx-ng 11.2.0 habdf983_11 conda-forge libthrift 0.15.0 h54f692e_1 conda-forge libutf8proc 2.6.1 h4e0d66e_0 conda-forge libzlib 1.2.11 h339bb43_1013 conda-forge lz4-c 1.9.3 h3b9df90_1 conda-forge ncurses 6.2 hea85c5d_4 conda-forge numpy 1.19.5 py36h86665d4_1 conda-forge openssl 1.1.1l h4e0d66e_0 conda-forge orc 1.7.0 hae6b4bd_0 conda-forge parquet-cpp 1.5.1 2 conda-forge pip 21.3 pyhd8ed1ab_0 conda-forge pyarrow 5.0.0 py36h7a46c7e_8_cpu conda-forge python 3.6.13 h57873ef_2_cpython conda-forge python_abi 3.6 2_cp36m conda-forge re2 2021.09.01 h3b9df90_0 conda-forge readline 8.1 h5c45dff_0 conda-forge s2n 1.0.10 h97db324_0 conda-forge setuptools 58.0.4 py36h6ffa863_0 snappy 1.1.8 hb209c28_3 conda-forge sqlite 3.36.0 h4e2196e_2 conda-forge tk 8.6.11 h41c6715_1 conda-forge wheel 0.37.0 pyhd8ed1ab_1 conda-forge xz 5.2.5 h6eb9509_1 conda-forge zlib 1.2.11 h339bb43_1013 conda-forge zstd 1.5.0 h65c4b1a_0 conda-forge
-----------
There seems to be a similar issue here:
https://issues.apache.org/jira/browse/ARROW-4272
But they fix it by conda installing, which doesn't work here.