[ARROW-13011] [Python] HadoopFileSystem crash when called twice and Java was misconfigured

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Python
• Labels: filesystem hdfs
• External issue URL: https://github.com/apache/arrow/issues/28727
• Assignee: Unassigned
• Reporter: Joris Van den Bossche
• Created: 08/Jun/21 15:42
• Updated: 11/Jan/23 08:30

Description

See https://github.com/dask/dask/pull/7752#issuecomment-856231163 and discussion below.

 

Didn't investigate yet (and I also think dask cannot yet use the new filesystem, since it has a different API, but it should nonetheless not crash ..), there is a docker workflow to reproduce the tests I can try.

Issue Links

• is caused by: HDFS-16084 getJNIEnv() returns invalid pointer when called twice after getGlobalJNIEnv() failed