[ARROW-17272] [Dev][Java] Running integration tests on JDK 18 with archery fails

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 10.0.0
• Component/s: Developer Tools, Java
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/32552
• Assignee: David Li
• Reporter: Raúl Cumplido
• Created: 01/Aug/22 14:32
• Updated: 11/Jan/23 11:49
• Resolved: 01/Aug/22 21:30

Description

Currently all our nightly integration tests are running with JDK 11. If we try to run them with JDK 18 the integration tests fail with:

2022-08-01T14:13:46.7801482Z Caused by: java.lang.reflect.InaccessibleObjectException: Unable to make field long java.nio.Buffer.address accessible: module java.base does not "opens java.nio" to unnamed module @47b35fc0
2022-08-01T14:13:46.7802091Z 	at java.base/java.lang.reflect.AccessibleObject.checkCanSetAccessible(AccessibleObject.java:354)
2022-08-01T14:13:46.7802604Z 	at java.base/java.lang.reflect.AccessibleObject.checkCanSetAccessible(AccessibleObject.java:297)
2022-08-01T14:13:46.7803059Z 	at java.base/java.lang.reflect.Field.checkCanSetAccessible(Field.java:180)
2022-08-01T14:13:46.7803450Z 	at java.base/java.lang.reflect.Field.setAccessible(Field.java:174)
2022-08-01T14:13:46.7803837Z 	at org.apache.arrow.memory.util.MemoryUtil.<clinit>(MemoryUtil.java:84)
2022-08-01T14:13:46.7804123Z 	... 8 more 

and

2022-08-01T14:13:46.7807862Z subprocess.CalledProcessError: Command '['java', '-Dio.netty.tryReflectionSetAccessible=true', '-Darrow.struct.conflict.policy=CONFLICT_APPEND', '-cp', '/arrow/java/tools/target/arrow-tools-9.0.0-SNAPSHOT-jar-with-dependencies.jar', 'org.apache.arrow.tools.Integration', '-a', '/tmp/tmpx0isaswn/abf94267_generated_decimal256.json_as_file', '-j', '/tmp/arrow-integration-2cw7c4nq/generated_decimal256.json', '-c', 'VALIDATE']' returned non-zero exit status 1. 

We seem to be missing on the archery command:

--add-opens 

https://github.com/apache/arrow/blob/546c3771a209cbcac5e03cf26e07bcd8c9601d5a/dev/archery/archery/integration/tester_java.py#L34-L37

as specified on:

https://arrow.apache.org/docs/dev/java/install.html#java-compatibility

There is a PR that reproduces the issue on ubuntu 22.04:
https://github.com/apache/arrow/pull/13762

and the job failure:

https://github.com/ursacomputing/crossbow/runs/7611294787?check_suite_focus=true

 

Issue Links

• links to: GitHub Pull Request #13765