[ARROW-18340] [Python] PyArrow C++ header files no longer always included in installed pyarrow

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 10.0.0
• Fix Version/s: 10.0.2, 11.0.0
• Component/s: Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/33509
• Assignee: Alenka Frim
• Reporter: Joris Van den Bossche
• Created: 16/Nov/22 12:23
• Updated: 11/Jan/23 11:59
• Resolved: 22/Nov/22 21:01

Description

We have a python build env var to control whether the Arrow C++ header files are included in the python package or not (PYARROW_BUNDLE_ARROW_CPP_HEADERS). This is set to True by default, and only in the conda recipe set to False.

After the cmake refactor, the Python C++ header files no longer live in the Arrow C++ package, and so should always be included in the python package, regardless of how arrow-cpp is installed.
Initially this was done, but it seems that https://github.com/apache/arrow/pull/13892 removed this unconditional copy of the PyArrow header files to pyarrow/include. Now it is only copied if PYARROW_BUNDLE_ARROW_CPP_HEADERS is enabled.

Issue Links

• relates to: ARROW-18129 [Python] get_include() gives wrong directory in conda environment
• links to: GitHub Pull Request #14656