Description
- This will make hadoop-azure not show up in the hadoop classpath, though both hadoop-aws and hadoop-azure-datalake are in the classpath.
hadoop-env.sh
export HADOOP_OPTIONAL_TOOLS="hadoop-azure,hadoop-aws,hadoop-azure-datalake"
- And if we put only hadoop-azure and hadoop-aws, both of them are shown in the classpath.
hadoop-env.sh
export HADOOP_OPTIONAL_TOOLS="hadoop-azure,hadoop-aws"
This makes me guess that, while parsing the HADOOP_OPTIONAL_TOOLS, we make some assumptions that hadoop tool modules have a single "-" in names, and the hadoop-azure-datalake overrides the hadoop-azure. Or any other assumptions about the ${project.artifactId}?
Ping aw.