Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-3940

[Python/Documentation] Add required packages to the development instruction

    XMLWordPrintableJSON

    Details

      Description

      On Ubuntu 18.04 LTS, followed https://arrow.apache.org/docs/python/development.html#development and encountered some issues:

      1. Building Arrow C++ libraries failed as follows due to the lack of Autotools:

      $ make -j4
      
      (snip)
      
      CMake Error at /home/sekikn/arrow/cpp/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure-RELEASE.cmake:16 (message):
        Command failed: 1
      
         './autogen.sh' '--prefix=/home/sekikn/arrow/cpp/build/jemalloc_ep-prefix/src/jemalloc_ep/dist/' '--with-jemalloc-prefix=je_arrow_' '--with-private-namespace=je_arrow_private_' '--disable-tls'
      

      2. After installing autoconf package, building pyarrow failed as follows due to the lack of Python header files:

      $ python setup.py build_ext --build-type=$ARROW_BUILD_TYPE \
      >        --with-parquet --with-plasma --inplace
      
      (snip)
      
      [ 36%] Building CXX object src/arrow/python/CMakeFiles/arrow_python_objlib.dir/arrow_to_pandas.cc.o
      In file included from /home/sekikn/arrow/cpp/src/arrow/python/numpy_interop.h:21:0,
                       from /home/sekikn/arrow/cpp/src/arrow/python/arrow_to_pandas.cc:20:
      /home/sekikn/arrow/cpp/src/arrow/python/platform.h:25:10: fatal error: Python.h: No such file or directory
       #include <Python.h> // IWYU pragma: export
                ^~~~~~~~~~
      compilation terminated.
      src/arrow/python/CMakeFiles/arrow_python_objlib.dir/build.make:62: recipe for target 'src/arrow/python/CMakeFiles/arrow_python_objlib.dir/arrow_to_pandas.cc.o' failed
      make[2]: *** [src/arrow/python/CMakeFiles/arrow_python_objlib.dir/arrow_to_pandas.cc.o] Error 1
      CMakeFiles/Makefile2:1447: recipe for target 'src/arrow/python/CMakeFiles/arrow_python_objlib.dir/all' failed
      make[1]: *** [src/arrow/python/CMakeFiles/arrow_python_objlib.dir/all] Error 2
      

      3. Building a self-contained wheel failed as well due to the lack of wheel:

      $ python setup.py build_ext --build-type=$ARROW_BUILD_TYPE \
      >        --with-parquet --with-plasma --bundle-arrow-cpp bdist_wheel
      /usr/lib/python3.6/distutils/dist.py:261: UserWarning: Unknown distribution option: 'long_description_content_type'
        warnings.warn(msg)
      usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
         or: setup.py --help [cmd1 cmd2 ...]
         or: setup.py --help-commands
         or: setup.py cmd --help
      
      error: invalid command 'bdist_wheel'
      

        Attachments

          Activity

            People

            • Assignee:
              sekikn Kengo Seki
              Reporter:
              sekikn Kengo Seki
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 1.5h
                1.5h