[ARROW-7100] [C++] libjvm.so not found on ubuntu 19.04 with openjdk-11

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.15.1
• Fix Version/s: 0.16.0
• Component/s: C++
• Labels: pull-request-available
• Environment: ubuntu 19.04
• External issue URL: https://github.com/apache/arrow/issues/23406
• Assignee: Alexis Mignon
• Reporter: Alexis Mignon
• Created: 08/Nov/19 16:19
• Updated: 11/Jan/23 07:51
• Resolved: 13/Nov/19 02:33

Description

On ubuntu 19.04, with java-11 installed, the following code raises an error

 

$ python -c "import pyarrow as pa; pa.hdfs.connect()"
Traceback (most recent call last):
{{ File "<string>", line 1, in <module>}}
{{ File "/home/amignon/Projets/Sandbox/bwl_negbin/venv/lib/python3.7/site-packages/pyarrow/hdfs.py", line 215, in connect}}
{{ extra_conf=extra_conf)}}
{{ File "/home/amignon/Projets/Sandbox/bwl_negbin/venv/lib/python3.7/site-packages/pyarrow/hdfs.py", line 40, in _init_}}
{{ self._connect(host, port, user, kerb_ticket, driver, extra_conf)}}
{{ File "pyarrow/io-hdfs.pxi", line 89, in pyarrow.lib.HadoopFileSystem._connect}}
{{ File "pyarrow/error.pxi", line 80, in pyarrow.lib.check_status}}
pyarrow.lib.ArrowIOError: Unable to load libjvm

 

while it works with java-8 installed (even when JAVA_HOME points to java-11).

 

This seems to be due to a change in the directory structure of java. In java-11, libjvm lies in

/usr/lib/jvm/java-11-openjdk-amd64/lib/server/libjvm.so

Instead of

/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/libjvm.so

 

According to the code of hdfs_internal.cc the search suffixes on linux are:

 

  "/jre/lib/amd64/server", "/lib/amd64/server"

which would explain the problem.

This is confirmed by adding manually a amd64/server in the java-11 directory.

 

 

Issue Links

• links to: GitHub Pull Request #5810