Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-6766

[Python] libarrow_python..dylib does not exist

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.14.0, 0.15.0
    • Fix Version/s: None
    • Component/s: Python
    • Labels:
      None

      Description

      After following the instructions found on the developer guides for Python, I was
      able to build fine by using:

      # Assuming immediately prior one has run:
      # $ git clone git@github.com:apache/arrow.git

      1. $ conda create -y -n pyarrow-dev -c conda-forge 
        #   --file arrow/ci/conda_env_unix.yml 
        #   --file arrow/ci/conda_env_cpp.yml 
        #   --file arrow/ci/conda_env_python.yml 
        #    compilers 
        #  python=3.7
        # $ conda activate pyarrow-dev
        # $ brew update && brew bundle --file=arrow/cpp/Brewfileexport ARROW_HOME=$(pwd)/arrow/dist
        export LD_LIBRARY_PATH=$(pwd)/arrow/dist/lib:$LD_LIBRARY_PATHexport CC=`which clang`
        export CXX=`which clang++`{{mkdir arrow/cpp/build }}
            pushd arrow/cpp/build \
            cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \
            -DCMAKE_INSTALL_LIBDIR=lib \
            -DARROW_FLIGHT=OFF \
            -DARROW_GANDIVA=OFF \
            -DARROW_ORC=ON \
            -DARROW_PARQUET=ON \
            -DARROW_PYTHON=ON \
            -DARROW_PLASMA=ON \
            -DARROW_BUILD_TESTS=ON \
           ..
        make -j4
        make install
        popd

      But when I run:

      pushd arrow/python
      export PYARROW_WITH_FLIGHT=0
      export PYARROW_WITH_GANDIVA=0
      export PYARROW_WITH_ORC=1
      export PYARROW_WITH_PARQUET=1
      python setup.py build_ext --inplace
      popd

      I get the following errors:

      -- Build output directory: /Users/tallamjr/Github/arrow/python/build/temp.macosx-10.9-x86_64-3.7/release
      -- Found the Arrow core library: /usr/local/anaconda3/envs/pyarrow-dev/lib/libarrow.dylib
      -- Found the Arrow Python library: /usr/local/anaconda3/envs/pyarrow-dev/lib/libarrow_python.dylib
      CMake Error: File /usr/local/anaconda3/envs/pyarrow-dev/lib/libarrow..dylib does not exist....CMake Error: File /usr/local/anaconda3/envs/pyarrow-dev/lib/libarrow..dylib does not exist.
      CMake Error at CMakeLists.txt:230 (configure_file):
      {{ configure_file Problem configuring file}}
      Call Stack (most recent call first):
      {{ CMakeLists.txt:315 (bundle_arrow_lib)}}
      CMake Error: File /usr/local/anaconda3/envs/pyarrow-dev/lib/libarrow_python..dylib does not exist.
      CMake Error at CMakeLists.txt:226 (configure_file):
      {{ configure_file Problem configuring file}}
      Call Stack (most recent call first):
      {{ CMakeLists.txt:320 (bundle_arrow_lib)}}
      CMake Error: File /usr/local/anaconda3/envs/pyarrow-dev/lib/libarrow_python..dylib does not exist.
      CMake Error at CMakeLists.txt:230 (configure_file):
      {{ configure_file Problem configuring file}}
      Call Stack (most recent call first):
      {{ CMakeLists.txt:320 (bundle_arrow_lib)}}

       

      What is quite strange is that the libraries seem to indeed be there but they
      have an addition component such as `libarrow.15.dylib` .e.g:

      $ ls -l libarrow_python.15.dylib && echo $PWD
      lrwxr-xr-x 1 tallamjr staff 28 Oct 2 14:02 libarrow_python.15.dylib ->
      libarrow_python.15.0.0.dylib
      /Users/tallamjr/github/arrow/dist/lib

      I guess I am not exactly sure what the issue here is but it appears to be that
      the version is not captured as a variable that is used by CMAKE? I have run the
      same setup on `master` (`7d18c1c`) and on `apache-arrow-0.14.0` (`a591d76`)
      which both seem to produce same errors.

      Apologies if this is not quite the format for JIRA issues here or perhaps if
      it's not the correct platform for this, I'm very new to the project and
      contributing to apache in general. Thanks

       

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              tallamjr Tarek Allam
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: