Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10548

Correct commons-math dependency version

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.96.2, 0.98.1, 0.99.0
    • Fix Version/s: 0.96.2, 0.98.1, 0.99.0, hbase-10070
    • Component/s: test
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Downgrades HBase's dependency on commons-math to 2.1, which is consistent with all stable releases of Hadoop.

      Description

      From my comment on HBASE-10511:

      I have hadoop-1.2.1 installed from tgz, which packages commons-math-2.1. This is different from the listed maven dependency, 2.2.

      $ tar tvf hadoop-1.2.1.tar.gz | grep commons-math
      -rw-rw-r--  0 0      0      832410 Jul 22  2013 hadoop-1.2.1/lib/commons-math-2.1.jar
      $ mvn -f pom.xml.hadoop1 dependency:tree | grep commons-math
      [INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
      [INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
      [INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
      [INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
      [INFO] +- org.apache.commons:commons-math:jar:2.2:compile
      [INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile
      [INFO] +- org.apache.commons:commons-math:jar:2.2:compile
      [INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile
      [INFO] +- org.apache.commons:commons-math:jar:2.2:compile
      [INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile
      [INFO] |  +- org.apache.commons:commons-math:jar:2.2:compile
      

      This is a problem because the 2.1 version of DescriptiveStatistics doesn't have a double[] constructor. Running the MR job, mappers fail:

      java.lang.NoSuchMethodError: org.apache.commons.math.stat.descriptive.DescriptiveStatistics.<init>([D)V
      	at org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest.testTakedown(PerformanceEvaluation.java:1163)
      	at org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:984)
      	at org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:1401)
      	at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:522)
      	at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:474)
      	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
      

        Attachments

        1. HBASE-10548.01-0.98.patch
          2 kB
          Nick Dimiduk
        2. HBASE-10548.01-0.96.patch
          2 kB
          Nick Dimiduk
        3. HBASE-10548.01.patch
          2 kB
          Nick Dimiduk
        4. HBASE-10548.00.patch
          1 kB
          Nick Dimiduk

          Issue Links

            Activity

              People

              • Assignee:
                ndimiduk Nick Dimiduk
                Reporter:
                ndimiduk Nick Dimiduk
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: