Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-812

Pip install pyarrow on mac failed.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.3.0
    • Python
    • None

    Description

      MacOS Sierra version 10.12
      pip install pyarrow failed, got below message. It seems I need to install arrow and parquet-cpp before use pip to install.

      Collecting pyarrow
      Using cached pyarrow-0.2.0.tar.gz
      Requirement already satisfied: cython>=0.23 in /usr/local/lib/python2.7/site-packages (from pyarrow)
      Requirement already satisfied: numpy>=1.9 in /usr/local/lib/python2.7/site-packages (from pyarrow)
      Requirement already satisfied: six>=1.0.0 in /usr/local/lib/python2.7/site-packages (from pyarrow)
      Building wheels for collected packages: pyarrow
      Running setup.py bdist_wheel for pyarrow ... error
      Complete output from command /usr/local/opt/python/bin/python2.7 u -c "import setuptools, tokenize;_file='/private/var/folders/p9/8p8qsbcx26j7sgpph5jtwmn40000gn/T/pip-build-FbVwUo/pyarrow/setup.py';f=getattr(tokenize, 'open', open)(file);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file_, 'exec'))" bdist_wheel -d /var/folders/p9/8p8qsbcx26j7sgpph5jtwmn40000gn/T/tmpND_0jypip-wheel --python-tag cp27:
      /usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'test_requires'
      warnings.warn(msg)
      running bdist_wheel
      running build
      running build_py
      creating build
      creating build/lib.macosx-10.12-x86_64-2.7
      creating build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/_init_.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/compat.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/filesystem.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/formatting.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/ipc.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/parquet.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/util.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      creating build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/_init_.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/pandas_examples.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_array.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_convert_builtin.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_convert_pandas.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_hdfs.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_io.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_ipc.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_jemalloc.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_parquet.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_scalars.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_schema.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_table.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/_parquet.pxd -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/array.pxd -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/error.pxd -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/io.pxd -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/memory.pxd -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/scalar.pxd -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/schema.pxd -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/table.pxd -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/_parquet.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/array.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/config.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/error.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/io.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/jemalloc.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/memory.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/scalar.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/schema.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/table.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      running build_ext
      creating build/temp.macosx-10.12-x86_64-2.7
      cmake -DPYTHON_EXECUTABLE=/usr/local/opt/python/bin/python2.7 -DPYARROW_BUILD_TESTS=off -DCMAKE_BUILD_TYPE=debug /private/var/folders/p9/8p8qsbcx26j7sgpph5jtwmn40000gn/T/pip-build-FbVwUo/pyarrow
      – The C compiler identification is AppleClang 8.1.0.8020041
      – The CXX compiler identification is AppleClang 8.1.0.8020041
      – Check for working C compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/cc
      – Check for working C compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/cc – works
      – Detecting C compiler ABI info
      – Detecting C compiler ABI info - done
      – Detecting C compile features
      – Detecting C compile features - done
      – Check for working CXX compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/c++
      – Check for working CXX compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/c++ – works
      – Detecting CXX compiler ABI info
      – Detecting CXX compiler ABI info - done
      – Detecting CXX compile features
      – Detecting CXX compile features - done
      CMake Error at CMakeLists.txt:75 (include):
      include could not find load file:

      SetupCxxFlags

      INFO Apple LLVM version 8.1.0 (clang-802.0.41)
      Target: x86_64-apple-darwin16.0.0
      Thread model: posix
      InstalledDir: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin

      Selected compiler clang
      Using static linking for debug builds
      Using ld linker
      CMake Warning (dev) at CMakeLists.txt:167 (if):
      Policy CMP0054 is not set: Only interpret if() arguments as variables or
      keywords when unquoted. Run "cmake --help-policy CMP0054" for policy
      details. Use the cmake_policy command to set the policy and suppress this
      warning.

      Quoted variables like "d" will no longer be dereferenced when the policy is
      set to NEW. Since the policy is not set the OLD behavior will be used.
      This warning is for project developers. Use -Wno-dev to suppress it.

      – Found PythonInterp: /usr/local/opt/python/bin/python2.7 (found version "2.7.13")
      – Found PythonLibs:
      – Found NumPy: version "1.11.2" /usr/local/lib/python2.7/site-packages/numpy/core/include
      – Found Cython: /usr/local/bin/cython
      – Could not find the Parquet library. Looked in in /usr/local.
      – Found the Arrow core library: /usr/local/lib/libarrow.dylib
      – Found the Arrow IO library: /usr/local/lib/libarrow_io.dylib
      – Found the Arrow IPC library: /usr/local/lib/libarrow_ipc.dylib
      – Found the Arrow jemalloc library: /usr/local/lib/libarrow_jemalloc.dylib
      – Added shared library dependency arrow: /usr/local/lib/libarrow.dylib
      – Added shared library dependency arrow_io: /usr/local/lib/libarrow_io.dylib
      – Added shared library dependency arrow_ipc: /usr/local/lib/libarrow_ipc.dylib
      – Configuring incomplete, errors occurred!
      See also "/private/var/folders/p9/8p8qsbcx26j7sgpph5jtwmn40000gn/T/pip-build-FbVwUo/pyarrow/build/temp.macosx-10.12-x86_64-2.7/CMakeFiles/CMakeOutput.log".
      error: command 'cmake' failed with exit status 1

      ----------------------------------------
      Failed building wheel for pyarrow
      Running setup.py clean for pyarrow
      Failed to build pyarrow
      Installing collected packages: pyarrow
      Running setup.py install for pyarrow ... error
      Complete output from command /usr/local/opt/python/bin/python2.7 -u -c "import setuptools, tokenize;_file='/private/var/folders/p9/8p8qsbcx26j7sgpph5jtwmn40000gn/T/pip-build-FbVwUo/pyarrow/setup.py';f=getattr(tokenize, 'open', open)(file);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file_, 'exec'))" install --record /var/folders/p9/8p8qsbcx26j7sgpph5jtwmn40000gn/T/pip-iCXA1N-record/install-record.txt --single-version-externally-managed --compile:
      /usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'test_requires'
      warnings.warn(msg)
      running install
      running build
      running build_py
      creating build
      creating build/lib.macosx-10.12-x86_64-2.7
      creating build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/_init_.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/compat.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/filesystem.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/formatting.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/ipc.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/parquet.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/util.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      creating build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/_init_.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/pandas_examples.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_array.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_convert_builtin.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_convert_pandas.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_hdfs.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_io.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_ipc.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_jemalloc.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_parquet.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_scalars.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_schema.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/tests/test_table.py -> build/lib.macosx-10.12-x86_64-2.7/pyarrow/tests
      copying pyarrow/_parquet.pxd -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/array.pxd -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/error.pxd -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/io.pxd -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/memory.pxd -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/scalar.pxd -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/schema.pxd -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/table.pxd -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/_parquet.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/array.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/config.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/error.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/io.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/jemalloc.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/memory.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/scalar.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/schema.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      copying pyarrow/table.pyx -> build/lib.macosx-10.12-x86_64-2.7/pyarrow
      running build_ext
      creating build/temp.macosx-10.12-x86_64-2.7
      cmake -DPYTHON_EXECUTABLE=/usr/local/opt/python/bin/python2.7 -DPYARROW_BUILD_TESTS=off -DCMAKE_BUILD_TYPE=debug /private/var/folders/p9/8p8qsbcx26j7sgpph5jtwmn40000gn/T/pip-build-FbVwUo/pyarrow
      – The C compiler identification is AppleClang 8.1.0.8020041
      – The CXX compiler identification is AppleClang 8.1.0.8020041
      – Check for working C compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/cc
      – Check for working C compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/cc – works
      – Detecting C compiler ABI info
      – Detecting C compiler ABI info - done
      – Detecting C compile features
      – Detecting C compile features - done
      – Check for working CXX compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/c++
      – Check for working CXX compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/c++ – works
      – Detecting CXX compiler ABI info
      – Detecting CXX compiler ABI info - done
      – Detecting CXX compile features
      – Detecting CXX compile features - done
      CMake Error at CMakeLists.txt:75 (include):
      include could not find load file:

      SetupCxxFlags

      INFO Apple LLVM version 8.1.0 (clang-802.0.41)
      Target: x86_64-apple-darwin16.0.0
      Thread model: posix
      InstalledDir: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin

      Selected compiler clang
      Using static linking for debug builds
      Using ld linker
      CMake Warning (dev) at CMakeLists.txt:167 (if):
      Policy CMP0054 is not set: Only interpret if() arguments as variables or
      keywords when unquoted. Run "cmake --help-policy CMP0054" for policy

      details. Use the cmake_policy command to set the policy and suppress this
      warning.

      Quoted variables like "d" will no longer be dereferenced when the policy is
      set to NEW. Since the policy is not set the OLD behavior will be used.
      This warning is for project developers. Use -Wno-dev to suppress it.

      – Found PythonInterp: /usr/local/opt/python/bin/python2.7 (found version "2.7.13")
      – Found PythonLibs:
      – Found NumPy: version "1.11.2" /usr/local/lib/python2.7/site-packages/numpy/core/include
      – Found Cython: /usr/local/bin/cython
      – Could not find the Parquet library. Looked in in /usr/local.
      – Found the Arrow core library: /usr/local/lib/libarrow.dylib
      – Found the Arrow IO library: /usr/local/lib/libarrow_io.dylib
      – Found the Arrow IPC library: /usr/local/lib/libarrow_ipc.dylib
      – Found the Arrow jemalloc library: /usr/local/lib/libarrow_jemalloc.dylib
      – Added shared library dependency arrow: /usr/local/lib/libarrow.dylib
      – Added shared library dependency arrow_io: /usr/local/lib/libarrow_io.dylib
      – Added shared library dependency arrow_ipc: /usr/local/lib/libarrow_ipc.dylib
      – Configuring incomplete, errors occurred!
      See also "/private/var/folders/p9/8p8qsbcx26j7sgpph5jtwmn40000gn/T/pip-build-FbVwUo/pyarrow/build/temp.macosx-10.12-x86_64-2.7/CMakeFiles/CMakeOutput.log".
      error: command 'cmake' failed with exit status 1

      ----------------------------------------
      Command "/usr/local/opt/python/bin/python2.7 -u -c "import setuptools, tokenize;_file='/private/var/folders/p9/8p8qsbcx26j7sgpph5jtwmn40000gn/T/pip-build-FbVwUo/pyarrow/setup.py';f=getattr(tokenize, 'open', open)(file);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file_, 'exec'))" install --record /var/folders/p9/8p8qsbcx26j7sgpph5jtwmn40000gn/T/pip-iCXA1N-record/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /private/var/folders/p9/8p8qsbcx26j7sgpph5jtwmn40000gn/T/pip-build-FbVwUo/pyarrow/

      Attachments

        Activity

          People

            Unassigned Unassigned
            jinlian jinlian
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: