[HBASE-10548] Correct commons-math dependency version

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.96.2, 0.98.1, 0.99.0
• Fix Version/s: 0.96.2, 0.98.1, 0.99.0, hbase-10070
• Component/s: test
• Hadoop Flags: Reviewed
• Release Note: Downgrades HBase's dependency on commons-math to 2.1, which is consistent with all stable releases of Hadoop.
• Assignee: Nick Dimiduk
• Reporter: Nick Dimiduk
• Created: 15/Feb/14 02:19
• Updated: 21/Feb/15 23:29
• Resolved: 19/Feb/14 00:10

Description

From my comment on HBASE-10511:

I have hadoop-1.2.1 installed from tgz, which packages commons-math-2.1. This is different from the listed maven dependency, 2.2.

$ tar tvf hadoop-1.2.1.tar.gz | grep commons-math
-rw-rw-r--  0 0      0      832410 Jul 22  2013 hadoop-1.2.1/lib/commons-math-2.1.jar
$ mvn -f pom.xml.hadoop1 dependency:tree | grep commons-math
[INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
[INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
[INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
[INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
[INFO] +- org.apache.commons:commons-math:jar:2.2:compile
[INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile
[INFO] +- org.apache.commons:commons-math:jar:2.2:compile
[INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile
[INFO] +- org.apache.commons:commons-math:jar:2.2:compile
[INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile
[INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile

This is a problem because the 2.1 version of DescriptiveStatistics doesn't have a double[] constructor. Running the MR job, mappers fail:

java.lang.NoSuchMethodError: org.apache.commons.math.stat.descriptive.DescriptiveStatistics.<init>([D)V
	at org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest.testTakedown(PerformanceEvaluation.java:1163)
	at org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:984)
	at org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:1401)
	at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:522)
	at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:474)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)

Issue Links

• is depended upon by: HBASE-10791 Add integration test to demonstrate performance improvement
• relates to: HBASE-10511 Add latency percentiles on PerformanceEvaluation