[ARROW-4690] [Python] Building TensorFlow compatible wheels for Arrow

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.13.0
• Component/s: Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/21218
• Assignee: Philipp Moritz
• Reporter: Philipp Moritz
• Created: 26/Feb/19 22:39
• Updated: 11/Jan/23 07:35
• Resolved: 28/Feb/19 23:17

Description

Since the inclusion of LLVM, arrow wheels stopped working with TensorFlow again (on some configurations at least).

While we are continuing to discuss a more permanent solution in https://groups.google.com/a/tensorflow.org/d/topic/developers/TMqRaT-H2bI/discussion, I made some progress in creating tensorflow compatible wheels for an unmodified pyarrow.

They won't adhere to the manylinux1 standard, but they should be as compatible as the TensorFlow wheels because they use the same build environment (ubuntu 14.04).

I'll create a PR with the necessary changes. I don't propose to ship these wheels but it might be a good idea to include the docker image and instructions how to build them in the tree for organizations that want to use tensorflow with pyarrow on top of pip. The official recommendation should probably be to use conda if the average user wants to do this for now.

Issue Links

• links to: GitHub Pull Request #3766