[ARROW-16493] Documented Java build process for native code fails on Apple M1 hardware

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 8.0.0
• Component/s: Java
• Environment: Apple MacBook Pro M1 hardware ; OSX Monterey 12.2.1
• External issue URL: https://github.com/apache/arrow/issues/31859
• Assignee: Larry White
• Reporter: Larry White
• Created: 06/May/22 13:47
• Updated: 11/Jan/23 11:44
• Resolved: 16/May/22 16:14

Description

A warning occurs while linking files in C Data Interface: 

{{[100%] Linking CXX shared library libarrow_cdata_jni.dylib}}

{}
{{ld: warning: ignoring file /Library/Java/JavaVirtualMachines/jdk-11.0.13.jdk/Contents/Home/lib/server/libjvm.dylib, building for macOS-arm64 but attempting to link with file built for macOS-x86_64}}

 

Followed by numerous test failures later in the process, for example:

 

[ERROR] Tests run: 45, Failures: 0, Errors: 45, Skipped: 0, Time elapsed: 0.725 s <<< FAILURE! - in org.apache.arrow.c.RoundtripTest[ERROR] testUInt8Vector  Time elapsed: 0.054 s  <<< ERROR!java.lang.ExceptionInInitializerErrorat org.apache.arrow.c.RoundtripTest.vectorRoundtrip(RoundtripTest.java:129)at org.apache.arrow.c.RoundtripTest.roundtrip(RoundtripTest.java:155)at org.apache.arrow.c.RoundtripTest.testUInt8Vector(RoundtripTest.java:463)Caused by: java.lang.IllegalStateException: error loading native libraries: java.io.FileNotFoundException: libarrow_cdata_jni.dylib at org.apache.arrow.c.RoundtripTest.vectorRoundtrip(RoundtripTest.java:129)at org.apache.arrow.c.RoundtripTest.roundtrip(RoundtripTest.java:155)at org.apache.arrow.c.RoundtripTest.testUInt8Vector(RoundtripTest.java:463)

 

Steps to reproduce: 

On Apple M1 hardware, follow the build instructions at https://arrow.apache.org/docs/dev/developers/java/building.html 

Follow instructions to build the C Data interface. (warning occurs){}

Continue to follow instructions to build remaining JNI interfaces. (test failures occur). {{}}

 

Note that the file that cannot be found is the same file being linked when the earlier warning occurs.

Issue Links

• is related to: ARROW-16534 [Java] Update gandiva protobuf library version to support M1