[HADOOP-14498] HADOOP_OPTIONAL_TOOLS not parsed correctly

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0-alpha1
• Component/s: build
• Target Version/s: 3.5.0
• Assignee: Sean Mackrory
• Reporter: Mingliang Liu
• Created: 06/Jun/17 20:30
• Updated: 04/Jan/24 12:08

Description

1. This will make hadoop-azure not show up in the hadoop classpath, though both hadoop-aws and hadoop-azure-datalake are in the classpath.
   hadoop-env.sh

   export HADOOP_OPTIONAL_TOOLS="hadoop-azure,hadoop-aws,hadoop-azure-datalake"
   

2. And if we put only hadoop-azure and hadoop-aws, both of them are shown in the classpath.
   hadoop-env.sh

   export HADOOP_OPTIONAL_TOOLS="hadoop-azure,hadoop-aws"
   

This makes me guess that, while parsing the HADOOP_OPTIONAL_TOOLS, we make some assumptions that hadoop tool modules have a single "-" in names, and the hadoop-azure-datalake overrides the hadoop-azure. Or any other assumptions about the ${project.artifactId}?

Ping aw.