HBase
  1. HBase
  2. HBASE-10489

TestImportExport fails in 0.94 with Hadoop2

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.94.17
    • Component/s: test
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      With HBASE-10363 fixed, we're now seeing other M/R tests failing.
      TestImportExport is one of them.

      1. 10489.txt
        4 kB
        Lars Hofhansl

        Activity

        Hide
        Lars Hofhansl added a comment -

        Here's a simple fix. The issue was to make it work for both Hadoop1 and Hadoop2.
        The test used to get the configuration from the cluster. The various Mini*Clusters mess around with the configuration enough to have this fail with Hadoop2.
        Hadoop1 failed with UTIL configuration. After diff'ing the configurations I found the issue was that mapred.job.tracker was set to localhost:40462 un UTIL.
        Forcing that to "local" makes it work again for Hadoop1.

        So in total this patch works Hadoop1 and Hadoop2.

        Planning to commit tomorrow (it's an uncontroversial test change, I think)

        Show
        Lars Hofhansl added a comment - Here's a simple fix. The issue was to make it work for both Hadoop1 and Hadoop2. The test used to get the configuration from the cluster. The various Mini*Clusters mess around with the configuration enough to have this fail with Hadoop2. Hadoop1 failed with UTIL configuration. After diff'ing the configurations I found the issue was that mapred.job.tracker was set to localhost:40462 un UTIL. Forcing that to "local" makes it work again for Hadoop1. So in total this patch works Hadoop1 and Hadoop2. Planning to commit tomorrow (it's an uncontroversial test change, I think)
        Hide
        stack added a comment -

        lgtm

        Show
        stack added a comment - lgtm
        Hide
        Lars Hofhansl added a comment -

        Thanks. Lemme commit then.

        Show
        Lars Hofhansl added a comment - Thanks. Lemme commit then.
        Hide
        Lars Hofhansl added a comment -

        Committed to 0.94 only. Thanks for looking stack

        Show
        Lars Hofhansl added a comment - Committed to 0.94 only. Thanks for looking stack
        Hide
        Lars Hofhansl added a comment -

        Hmm... One of the tests still failed in the latest build (but for a different reason, which does not happen locally).

        Show
        Lars Hofhansl added a comment - Hmm... One of the tests still failed in the latest build (but for a different reason, which does not happen locally).
        Hide
        Hudson added a comment -

        FAILURE: Integrated in HBase-0.94-on-Hadoop-2 #14 (See https://builds.apache.org/job/HBase-0.94-on-Hadoop-2/14/)
        HBASE-10489 TestImportExport fails in 0.94 with Hadoop2. (larsh: rev 1566484)

        • /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
        Show
        Hudson added a comment - FAILURE: Integrated in HBase-0.94-on-Hadoop-2 #14 (See https://builds.apache.org/job/HBase-0.94-on-Hadoop-2/14/ ) HBASE-10489 TestImportExport fails in 0.94 with Hadoop2. (larsh: rev 1566484) /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in HBase-0.94-security #405 (See https://builds.apache.org/job/HBase-0.94-security/405/)
        HBASE-10489 TestImportExport fails in 0.94 with Hadoop2. (larsh: rev 1566484)

        • /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
        Show
        Hudson added a comment - SUCCESS: Integrated in HBase-0.94-security #405 (See https://builds.apache.org/job/HBase-0.94-security/405/ ) HBASE-10489 TestImportExport fails in 0.94 with Hadoop2. (larsh: rev 1566484) /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
        Hide
        Hudson added a comment -

        ABORTED: Integrated in HBase-0.94 #1279 (See https://builds.apache.org/job/HBase-0.94/1279/)
        HBASE-10489 TestImportExport fails in 0.94 with Hadoop2. (larsh: rev 1566484)

        • /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
        Show
        Hudson added a comment - ABORTED: Integrated in HBase-0.94 #1279 (See https://builds.apache.org/job/HBase-0.94/1279/ ) HBASE-10489 TestImportExport fails in 0.94 with Hadoop2. (larsh: rev 1566484) /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
        Hide
        Hudson added a comment -

        ABORTED: Integrated in HBase-0.94-JDK7 #43 (See https://builds.apache.org/job/HBase-0.94-JDK7/43/)
        HBASE-10489 TestImportExport fails in 0.94 with Hadoop2. (larsh: rev 1566484)

        • /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
        Show
        Hudson added a comment - ABORTED: Integrated in HBase-0.94-JDK7 #43 (See https://builds.apache.org/job/HBase-0.94-JDK7/43/ ) HBASE-10489 TestImportExport fails in 0.94 with Hadoop2. (larsh: rev 1566484) /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
        Hide
        Lars Hofhansl added a comment -

        Passed in latest run. It seems either TestImportExport or TestImportTsv passes now. There are some interactions between the tests.

        Show
        Lars Hofhansl added a comment - Passed in latest run. It seems either TestImportExport or TestImportTsv passes now. There are some interactions between the tests.

          People

          • Assignee:
            Lars Hofhansl
            Reporter:
            Lars Hofhansl
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development