[ARROW-11555] The pyarrow installation is not built with support for 'HadoopFileSystem'

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Invalid
• Affects Version/s: 3.0.0
• Component/s: Python
• Environment: Ubuntu 20.04 LTS ; conda 4.8.3 ; Python 3.7.7 ; pyarrow=3.0.0
• External issue URL: https://github.com/apache/arrow/issues/27427
• Assignee: Uwe Korn
• Reporter: Nikolai Janakiev
• Created: 08/Feb/21 12:47
• Updated: 11/Jan/23 08:20
• Resolved: 08/Feb/21 14:21

Description

When running:

import pyarrow as pa

pa.fs.HadoopFileSystem("node-master", port=54310)

I get the following error:

ImportError: The pyarrow installation is not built with support for 'HadoopFileSystem'

Installed on Ubuntu 20.04 LTS and via:

conda install -c conda-forge "pyarrow=3.0.0"

But when I run the following command, I am able to connect to my HDFS cluster:

hdfs = pa.hdfs.connect('node-master', port=54310)