Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Invalid
-
1.0.3
-
None
-
None
Description
hadoop install references commons-lang-2.4.jar while hadoop-core dependency references commons-lang:jar:2.6 as shown in maven dependency:tree command output extract.
org.apache.hadoop:hadoop-core:jar:1.0.3:provided +- commons-cli:commons-cli:jar:1.2:provided +- xmlenc:xmlenc:jar:0.52:provided +- commons-httpclient:commons-httpclient:jar:3.0.1:provided +- commons-codec:commons-codec:jar:1.4:provided +- org.apache.commons:commons-math:jar:2.1:provided +- commons-configuration:commons-configuration:jar:1.6:provided | +- commons-collections:commons-collections:jar:3.2.1:provided | +- commons-lang:commons-lang:jar:2.6:provided (version managed from 2.4)
Hadoop install libs should be consistent with hadoop-core maven dependencies.
I found this error because I was using a feature available in commons-lang.2.6 that was failing when executed in my hadoop cluster (but not with m pigunit tests).
A last remark, it would be nice to display the classpath used by hadoop cluster while executing a job, because these kinds of errors are not easy to find.