[HADOOP-16649] Defining hadoop-azure and hadoop-azure-datalake in HADOOP_OPTIONAL_TOOLS will ignore hadoop-azure

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.2.1
• Component/s: bin
• Labels: pull-request-available

Environment

Shell, but it also trickles down into all code using `FileSystem` 

• Assignee: Unassigned
• Reporter: Tom Lous
• Created: 10/Oct/19 09:53
• Updated: 28/Jul/22 12:37

Description

When defining both `hadoop-azure` and `hadoop-azure-datalake` in HADOOP_OPTIONAL_TOOLS in `conf/hadoop-env.sh`, `hadoop-azure` will get ignored.

eg setting this:

HADOOP_OPTIONAL_TOOLS="hadoop-azure-datalake,hadoop-azure"

 

 with debug on:

 

DEBUG: Profiles: importing /opt/hadoop/libexec/shellprofile.d/hadoop-azure-datalake.sh
DEBUG: HADOOP_SHELL_PROFILES accepted hadoop-azure-datalake
DEBUG: Profiles: importing /opt/hadoop/libexec/shellprofile.d/hadoop-azure.sh
DEBUG: HADOOP_SHELL_PROFILES
DEBUG: HADOOP_SHELL_PROFILES declined hadoop-azure hadoop-azure

 

whereas:

 

HADOOP_OPTIONAL_TOOLS="hadoop-azure"

 

 with debug on:

DEBUG: Profiles: importing /opt/hadoop/libexec/shellprofile.d/hadoop-azure.sh
DEBUG: HADOOP_SHELL_PROFILES accepted hadoop-azure

 

Issue Links

• links to: GitHub Pull Request #2385