[ARROW-16284] [Python][Packaging] Use delocate-fuse to create universal2 wheels

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 8.0.0
• Component/s: Packaging, Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/31675
• Assignee: Krisztian Szucs
• Reporter: Krisztian Szucs
• Created: 22/Apr/22 16:02
• Updated: 11/Jan/23 11:43
• Resolved: 22/Apr/22 17:26

Description

Previously we used specific universal2 configurations for vcpkg to build the dependencies containing symbols for both architectures. This approach proved to be fragile to vcpkg changes making it hard to upgrade the vcpkg version. As an example https://github.com/apache/arrow/pull/12893 bumps the vcpkg version where absl has stopped compiling for two CMAKE_OSX_ARCHITECTURES, it has been already fixed in absl's upstream but that hasn't been released yet.

The new approach uses multibuild's delocate to build the wheels for both arm64 and amd64 separately and fuse them in an upcoming step to a universal2 wheel (using lipo under the hood).

Issue Links

• links to: GitHub Pull Request #12959