HBase
  1. HBase
  2. HBASE-10562

Fix TestMultiTableInputFormat for Hadoop 2 in 0.94

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.94.17
    • Component/s: None
    • Labels:
      None

      Description

      See parent. This test was removed from 0.95.2.
      While investigating while it fails in 0.94 with Hadoop2 I found it is extremely slow and uses up a lot of threads.

      stack, any input?

      1. 10562.txt
        0.7 kB
        Lars Hofhansl

        Activity

        Hide
        Lars Hofhansl added a comment -

        NM. Needed:

            conf.setBoolean("yarn.is.minicluster", true);
        

        Allows tests to pass on Hadoop2.

        None-contentious change going to commit.
        We might want to consider reenabling the test for 0.96 and above.
        (Andrew Purtell, stack, FYI)

        Show
        Lars Hofhansl added a comment - NM. Needed: conf.setBoolean( "yarn.is.minicluster" , true ); Allows tests to pass on Hadoop2. None-contentious change going to commit. We might want to consider reenabling the test for 0.96 and above. ( Andrew Purtell , stack , FYI)
        Hide
        Lars Hofhansl added a comment -

        Committed to 0.94.

        Show
        Lars Hofhansl added a comment - Committed to 0.94.
        Hide
        Andrew Purtell added a comment -

        set("apurtell.is.lgtm", true)

        Show
        Andrew Purtell added a comment - set("apurtell.is.lgtm", true)
        Hide
        Lars Hofhansl added a comment -

        Do you think we should resurrect this test in 0.96, 0.98, or trunk?

        Show
        Lars Hofhansl added a comment - Do you think we should resurrect this test in 0.96, 0.98, or trunk?
        Hide
        Andrew Purtell added a comment -

        Put up a trunk patch, let's see.

        Show
        Andrew Purtell added a comment - Put up a trunk patch, let's see.
        Hide
        Hudson added a comment -

        FAILURE: Integrated in HBase-0.94-on-Hadoop-2 #27 (See https://builds.apache.org/job/HBase-0.94-on-Hadoop-2/27/)
        HBASE-10562 Fix TestMultiTableInputFormat for Hadoop 2 in 0.94. (larsh: rev 1569165)

        • /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
        Show
        Hudson added a comment - FAILURE: Integrated in HBase-0.94-on-Hadoop-2 #27 (See https://builds.apache.org/job/HBase-0.94-on-Hadoop-2/27/ ) HBASE-10562 Fix TestMultiTableInputFormat for Hadoop 2 in 0.94. (larsh: rev 1569165) /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in HBase-0.94-JDK7 #57 (See https://builds.apache.org/job/HBase-0.94-JDK7/57/)
        HBASE-10562 Fix TestMultiTableInputFormat for Hadoop 2 in 0.94. (larsh: rev 1569165)

        • /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
        Show
        Hudson added a comment - SUCCESS: Integrated in HBase-0.94-JDK7 #57 (See https://builds.apache.org/job/HBase-0.94-JDK7/57/ ) HBASE-10562 Fix TestMultiTableInputFormat for Hadoop 2 in 0.94. (larsh: rev 1569165) /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
        Hide
        Lars Hofhansl added a comment -

        Meh. Still failed in latest hadoop2 run. It does pass locally, though.

        Show
        Lars Hofhansl added a comment - Meh. Still failed in latest hadoop2 run. It does pass locally, though.
        Hide
        Hudson added a comment -

        FAILURE: Integrated in HBase-0.94-security #416 (See https://builds.apache.org/job/HBase-0.94-security/416/)
        HBASE-10562 Fix TestMultiTableInputFormat for Hadoop 2 in 0.94. (larsh: rev 1569165)

        • /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
        Show
        Hudson added a comment - FAILURE: Integrated in HBase-0.94-security #416 (See https://builds.apache.org/job/HBase-0.94-security/416/ ) HBASE-10562 Fix TestMultiTableInputFormat for Hadoop 2 in 0.94. (larsh: rev 1569165) /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in HBase-0.94 #1293 (See https://builds.apache.org/job/HBase-0.94/1293/)
        HBASE-10562 Fix TestMultiTableInputFormat for Hadoop 2 in 0.94. (larsh: rev 1569165)

        • /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
        Show
        Hudson added a comment - SUCCESS: Integrated in HBase-0.94 #1293 (See https://builds.apache.org/job/HBase-0.94/1293/ ) HBASE-10562 Fix TestMultiTableInputFormat for Hadoop 2 in 0.94. (larsh: rev 1569165) /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
        Hide
        stack added a comment -

        It was disabled because couldn't get it to pass reliably.

        Show
        stack added a comment - It was disabled because couldn't get it to pass reliably.
        Hide
        Lars Hofhansl added a comment -

        Yeah, I am seeing the same in 0.94 and Hadoop 2. Passes fine locally, but fails frequently on the Jenkins build. It seems it actually starts a lot of processes/threads, so it might just be too much for the poor jenkins boxes.

        Show
        Lars Hofhansl added a comment - Yeah, I am seeing the same in 0.94 and Hadoop 2. Passes fine locally, but fails frequently on the Jenkins build. It seems it actually starts a lot of processes/threads, so it might just be too much for the poor jenkins boxes.

          People

          • Assignee:
            Lars Hofhansl
            Reporter:
            Lars Hofhansl
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development