[ARROW-16566] [Java] Could not initialize class org.apache.arrow.dataset.jni.NativeMemoryPool

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 8.0.0
• Fix Version/s: 9.0.0
• Component/s: Java
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/31925
• Assignee: Jackey Lee
• Reporter: Jackey Lee
• Created: 13/May/22 03:33
• Updated: 11/Jan/23 11:44
• Resolved: 08/Jun/22 13:30

Description

We are using Arrow in Spark. When the specification is turned on, it is possible for the task to be forcibly killed during the running process. It means, `JniLoader.get().ensureLoaded()` maybe failed with `ClosedByInterruptException` when the task was killed. Meanwhile `NativeMemoryPool` use it as a static code, this leads to an init failure every time the NativeMemroyPool is trying to initialized and can never succeed. It would always fail to init `NativeMemoryPool` with `java.lang.NoClassDefFoundError: Could not initialize class org.apache.arrow.dataset.jni.NativeMemoryPool`

Issue Links

• links to: GitHub Pull Request #13146