HBase
  1. HBase
  2. HBASE-8140

TableMapReduceUtils#addDependencyJar fails when nested inside another MR job

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.98.0, 0.95.0
    • Component/s: mapreduce
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job to make sure dependencies of the job are shipped to the cluster. The code depends on finding an actual jar file containing the necessary classes. This is not always the case, for instance, when run at the end of another mapreduce job. In that case, dependency jars have already been shipped to the cluster and expanded in the parent job's run folder. Those dependencies are there, just not available as jars.

      1. 8140-port-jarfinder-0.94.patch
        17 kB
        Nick Dimiduk
      2. 8140-port-jarfinder-trunk.patch
        17 kB
        Nick Dimiduk
      3. 0001-HBASE-8140-addendum-add-test-category.patch
        2 kB
        Nick Dimiduk

        Issue Links

          Activity

          Hide
          Nick Dimiduk added a comment -

          Working on extending an integration test for this, but against trunk only.

          Show
          Nick Dimiduk added a comment - Working on extending an integration test for this, but against trunk only.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12574357/8140-port-jarfinder-trunk.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 7 new or modified tests.

          +1 hadoop2.0. The patch compiles against the hadoop 2.0 profile.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 lineLengths. The patch does not introduce lines longer than 100

          -1 site. The patch appears to cause mvn site goal to fail.

          -1 core tests. The patch failed these unit tests:
          org.apache.hadoop.hbase.TestCheckTestClasses

          Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//testReport/
          Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
          Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html
          Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
          Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html
          Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
          Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
          Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html
          Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
          Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12574357/8140-port-jarfinder-trunk.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 7 new or modified tests. +1 hadoop2.0 . The patch compiles against the hadoop 2.0 profile. +1 javadoc . The javadoc tool did not generate any warning messages. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 lineLengths . The patch does not introduce lines longer than 100 -1 site . The patch appears to cause mvn site goal to fail. -1 core tests . The patch failed these unit tests: org.apache.hadoop.hbase.TestCheckTestClasses Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/4890//console This message is automatically generated.
          Hide
          stack added a comment -

          Nick Dimiduk You want to include the IT test w/ this patch? Can I just commit this? (Is the TestCheckTestClasses because of this patch?)

          Show
          stack added a comment - Nick Dimiduk You want to include the IT test w/ this patch? Can I just commit this? (Is the TestCheckTestClasses because of this patch?)
          Hide
          Nick Dimiduk added a comment -

          stack This IT is turning out to be a pain. I've an open question with some MR guys about the behavior I'm seeing. We can add it as a separate ticket.

          Show
          Nick Dimiduk added a comment - stack This IT is turning out to be a pain. I've an open question with some MR guys about the behavior I'm seeing. We can add it as a separate ticket.
          Hide
          stack added a comment -

          Committed to trunk and 0.95.

          Lars Hofhansl Want this in 0.94? If not, I'll close as resolved.

          Thanks Nick.

          Show
          stack added a comment - Committed to trunk and 0.95. Lars Hofhansl Want this in 0.94? If not, I'll close as resolved. Thanks Nick.
          Hide
          Ted Yu added a comment -

          Looks like TestJarFinder misses test category.

          Show
          Ted Yu added a comment - Looks like TestJarFinder misses test category.
          Hide
          Nick Dimiduk added a comment -

          Blast, Ted Yu is correct. That must be the TestCheckTestClasses issue. I ran it directly, not via the harness. Let me add an addendum making this a SmallTest.

          Show
          Nick Dimiduk added a comment - Blast, Ted Yu is correct. That must be the TestCheckTestClasses issue. I ran it directly, not via the harness. Let me add an addendum making this a SmallTest.
          Hide
          Nick Dimiduk added a comment -

          Attaching addendum for trunk.

          Show
          Nick Dimiduk added a comment - Attaching addendum for trunk.
          Hide
          stack added a comment -

          Committed addendum to 0.95 and trunk. Thanks Nick (and Ted for figuring need of an addendum)

          Show
          stack added a comment - Committed addendum to 0.95 and trunk. Thanks Nick (and Ted for figuring need of an addendum)
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12574420/0001-HBASE-8140-addendum-add-test-category.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 4 new or modified tests.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/4898//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12574420/0001-HBASE-8140-addendum-add-test-category.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 4 new or modified tests. -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/4898//console This message is automatically generated.
          Hide
          Lars Hofhansl added a comment -

          Seems like a good fix. I have no good handle how risky this is, though. What do you guys think?

          Show
          Lars Hofhansl added a comment - Seems like a good fix. I have no good handle how risky this is, though. What do you guys think?
          Hide
          Nick Dimiduk added a comment -

          It's a sufficient fix, at least for the single use-case. I'm not convinced the OutputCommitter is the correct place to be launching a new job, but that's an HCAT problem. Assuming the JarFinder works, this will at least be more flexible for users, however the pains I'm having on the integration test warn me of trouble to come.

          Show
          Nick Dimiduk added a comment - It's a sufficient fix, at least for the single use-case. I'm not convinced the OutputCommitter is the correct place to be launching a new job, but that's an HCAT problem. Assuming the JarFinder works, this will at least be more flexible for users, however the pains I'm having on the integration test warn me of trouble to come.
          Hide
          Hudson added a comment -

          Integrated in hbase-0.95 #88 (See https://builds.apache.org/job/hbase-0.95/88/)
          HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job – ADDENDUM (Revision 1458544)
          HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job (Revision 1458532)

          Result = FAILURE
          stack :
          Files :

          • /hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java

          stack :
          Files :

          • /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
          • /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport
          • /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/JarFinder.java
          • /hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport
          • /hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java
          Show
          Hudson added a comment - Integrated in hbase-0.95 #88 (See https://builds.apache.org/job/hbase-0.95/88/ ) HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job – ADDENDUM (Revision 1458544) HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job (Revision 1458532) Result = FAILURE stack : Files : /hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java stack : Files : /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/JarFinder.java /hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport /hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java
          Hide
          Hudson added a comment -

          Integrated in HBase-TRUNK #3975 (See https://builds.apache.org/job/HBase-TRUNK/3975/)
          HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job – ADDENDUM (Revision 1458545)
          HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job (Revision 1458531)

          Result = FAILURE
          stack :
          Files :

          • /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java

          stack :
          Files :

          • /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
          • /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport
          • /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/JarFinder.java
          • /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport
          • /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java
          Show
          Hudson added a comment - Integrated in HBase-TRUNK #3975 (See https://builds.apache.org/job/HBase-TRUNK/3975/ ) HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job – ADDENDUM (Revision 1458545) HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job (Revision 1458531) Result = FAILURE stack : Files : /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java stack : Files : /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/JarFinder.java /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java
          Hide
          Hudson added a comment -

          Integrated in hbase-0.95-on-hadoop2 #34 (See https://builds.apache.org/job/hbase-0.95-on-hadoop2/34/)
          HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job – ADDENDUM (Revision 1458544)
          HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job (Revision 1458532)

          Result = FAILURE
          stack :
          Files :

          • /hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java

          stack :
          Files :

          • /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
          • /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport
          • /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/JarFinder.java
          • /hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport
          • /hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java
          Show
          Hudson added a comment - Integrated in hbase-0.95-on-hadoop2 #34 (See https://builds.apache.org/job/hbase-0.95-on-hadoop2/34/ ) HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job – ADDENDUM (Revision 1458544) HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job (Revision 1458532) Result = FAILURE stack : Files : /hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java stack : Files : /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/JarFinder.java /hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport /hbase/branches/0.95/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java
          Hide
          Hudson added a comment -

          Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #455 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/455/)
          HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job – ADDENDUM (Revision 1458545)
          HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job (Revision 1458531)

          Result = FAILURE
          stack :
          Files :

          • /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java

          stack :
          Files :

          • /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
          • /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport
          • /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/JarFinder.java
          • /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport
          • /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java
          Show
          Hudson added a comment - Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #455 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/455/ ) HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job – ADDENDUM (Revision 1458545) HBASE-8140 TableMapReduceUtils#addDependencyJar fails when nested inside another MR job (Revision 1458531) Result = FAILURE stack : Files : /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java stack : Files : /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/JarFinder.java /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java
          Hide
          stack added a comment -

          Resolving for now. Lets open new issue to backport to 0.94 when more confidence this not a destabilizing patch.

          Show
          stack added a comment - Resolving for now. Lets open new issue to backport to 0.94 when more confidence this not a destabilizing patch.
          Hide
          Nick Dimiduk added a comment -

          Opened HBASE-8158.

          Show
          Nick Dimiduk added a comment - Opened HBASE-8158 .
          Hide
          Hudson added a comment -

          Integrated in HBase-TRUNK #3996 (See https://builds.apache.org/job/HBase-TRUNK/3996/)
          HBASE-8147. Adds an integration test for HBASE-8140 (issue observed when commitJob was launching another job). (Revision 1461303)

          Result = FAILURE
          ddas :
          Files :

          • /hbase/trunk/hbase-it/src/test/java/org/apache/hadoop/hbase/mapreduce/IntegrationTestImportTsv.java
          Show
          Hudson added a comment - Integrated in HBase-TRUNK #3996 (See https://builds.apache.org/job/HBase-TRUNK/3996/ ) HBASE-8147 . Adds an integration test for HBASE-8140 (issue observed when commitJob was launching another job). (Revision 1461303) Result = FAILURE ddas : Files : /hbase/trunk/hbase-it/src/test/java/org/apache/hadoop/hbase/mapreduce/IntegrationTestImportTsv.java
          Hide
          Hudson added a comment -

          Integrated in hbase-0.95 #109 (See https://builds.apache.org/job/hbase-0.95/109/)
          HBASE-8147. Adds an integration test for HBASE-8140 (issue observed when commitJob was launching another job). (Revision 1461304)

          Result = FAILURE
          ddas :
          Files :

          • /hbase/branches/0.95/hbase-it/src/test/java/org/apache/hadoop/hbase/mapreduce/IntegrationTestImportTsv.java
          Show
          Hudson added a comment - Integrated in hbase-0.95 #109 (See https://builds.apache.org/job/hbase-0.95/109/ ) HBASE-8147 . Adds an integration test for HBASE-8140 (issue observed when commitJob was launching another job). (Revision 1461304) Result = FAILURE ddas : Files : /hbase/branches/0.95/hbase-it/src/test/java/org/apache/hadoop/hbase/mapreduce/IntegrationTestImportTsv.java
          Hide
          Hudson added a comment -

          Integrated in hbase-0.95-on-hadoop2 #45 (See https://builds.apache.org/job/hbase-0.95-on-hadoop2/45/)
          HBASE-8147. Adds an integration test for HBASE-8140 (issue observed when commitJob was launching another job). (Revision 1461304)

          Result = FAILURE
          ddas :
          Files :

          • /hbase/branches/0.95/hbase-it/src/test/java/org/apache/hadoop/hbase/mapreduce/IntegrationTestImportTsv.java
          Show
          Hudson added a comment - Integrated in hbase-0.95-on-hadoop2 #45 (See https://builds.apache.org/job/hbase-0.95-on-hadoop2/45/ ) HBASE-8147 . Adds an integration test for HBASE-8140 (issue observed when commitJob was launching another job). (Revision 1461304) Result = FAILURE ddas : Files : /hbase/branches/0.95/hbase-it/src/test/java/org/apache/hadoop/hbase/mapreduce/IntegrationTestImportTsv.java
          Hide
          Hudson added a comment -

          Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #466 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/466/)
          HBASE-8147. Adds an integration test for HBASE-8140 (issue observed when commitJob was launching another job). (Revision 1461303)

          Result = FAILURE
          ddas :
          Files :

          • /hbase/trunk/hbase-it/src/test/java/org/apache/hadoop/hbase/mapreduce/IntegrationTestImportTsv.java
          Show
          Hudson added a comment - Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #466 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/466/ ) HBASE-8147 . Adds an integration test for HBASE-8140 (issue observed when commitJob was launching another job). (Revision 1461303) Result = FAILURE ddas : Files : /hbase/trunk/hbase-it/src/test/java/org/apache/hadoop/hbase/mapreduce/IntegrationTestImportTsv.java
          Hide
          Hudson added a comment -

          Integrated in HBase-0.94 #951 (See https://builds.apache.org/job/HBase-0.94/951/)
          HBASE-8158. Backport HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job" (Nick Dimiduk) (Revision 1465743)

          Result = SUCCESS
          apurtell :
          Files :

          • /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
          • /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/JarFinder.java
          • /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport
          • /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java
          Show
          Hudson added a comment - Integrated in HBase-0.94 #951 (See https://builds.apache.org/job/HBase-0.94/951/ ) HBASE-8158 . Backport HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job" (Nick Dimiduk) (Revision 1465743) Result = SUCCESS apurtell : Files : /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/JarFinder.java /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java
          Hide
          Nick Dimiduk added a comment -

          Result = SUCCESS

          Woa! ^^^

          Show
          Nick Dimiduk added a comment - Result = SUCCESS Woa! ^^^
          Hide
          Hudson added a comment -

          Integrated in HBase-TRUNK #4044 (See https://builds.apache.org/job/HBase-TRUNK/4044/)
          HBASE-8158. Amend HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job" (Nick Dimiduk) (Revision 1465746)

          Result = FAILURE
          apurtell :
          Files :

          • /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
          Show
          Hudson added a comment - Integrated in HBase-TRUNK #4044 (See https://builds.apache.org/job/HBase-TRUNK/4044/ ) HBASE-8158 . Amend HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job" (Nick Dimiduk) (Revision 1465746) Result = FAILURE apurtell : Files : /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
          Hide
          Hudson added a comment -

          Integrated in hbase-0.95-on-hadoop2 #61 (See https://builds.apache.org/job/hbase-0.95-on-hadoop2/61/)
          HBASE-8158. Amend HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job" (Nick Dimiduk) (Revision 1465745)

          Result = FAILURE
          apurtell :
          Files :

          • /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
          Show
          Hudson added a comment - Integrated in hbase-0.95-on-hadoop2 #61 (See https://builds.apache.org/job/hbase-0.95-on-hadoop2/61/ ) HBASE-8158 . Amend HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job" (Nick Dimiduk) (Revision 1465745) Result = FAILURE apurtell : Files : /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
          Hide
          Lars Hofhansl added a comment -

          Woa! ^^^

          0.94 has been stable, so it shouldn't be a total surprise

          Show
          Lars Hofhansl added a comment - Woa! ^^^ 0.94 has been stable, so it shouldn't be a total surprise
          Hide
          Hudson added a comment -

          Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #488 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/488/)
          HBASE-8158. Amend HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job" (Nick Dimiduk) (Revision 1465746)

          Result = FAILURE
          apurtell :
          Files :

          • /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
          Show
          Hudson added a comment - Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #488 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/488/ ) HBASE-8158 . Amend HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job" (Nick Dimiduk) (Revision 1465746) Result = FAILURE apurtell : Files : /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
          Hide
          Hudson added a comment -

          Integrated in HBase-0.94-security #133 (See https://builds.apache.org/job/HBase-0.94-security/133/)
          HBASE-8158. Backport HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job" (Nick Dimiduk) (Revision 1465743)

          Result = SUCCESS
          apurtell :
          Files :

          • /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
          • /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/JarFinder.java
          • /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport
          • /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java
          Show
          Hudson added a comment - Integrated in HBase-0.94-security #133 (See https://builds.apache.org/job/HBase-0.94-security/133/ ) HBASE-8158 . Backport HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job" (Nick Dimiduk) (Revision 1465743) Result = SUCCESS apurtell : Files : /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/JarFinder.java /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/hadoopbackport/TestJarFinder.java
          Hide
          Lars Hofhansl added a comment -

          It looks like since this change org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan has not passed a single time in the EC2 builds (http://54.241.6.143/job/HBase-0.94/).
          Change was introduced in Build #72, since then this tests times out (or doesn't finish)

          Show
          Lars Hofhansl added a comment - It looks like since this change org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan has not passed a single time in the EC2 builds ( http://54.241.6.143/job/HBase-0.94/ ). Change was introduced in Build #72, since then this tests times out (or doesn't finish)
          Hide
          Nick Dimiduk added a comment -

          Taking a look.

          Show
          Nick Dimiduk added a comment - Taking a look.
          Hide
          Nick Dimiduk added a comment -

          opened HBASE-8326 to track this issue.

          Show
          Nick Dimiduk added a comment - opened HBASE-8326 to track this issue.
          Hide
          Andrew Purtell added a comment - - edited

          IIRC the EC2 jenkins builds went red one or two builds prior to this commit. And they all pass locally, repeatedly. However there are timeouts reported for 0.94 builds on the EC2 jenkins, this is why I want to get the HBASE-8303 patch in on 0.94 today.

          Show
          Andrew Purtell added a comment - - edited IIRC the EC2 jenkins builds went red one or two builds prior to this commit. And they all pass locally, repeatedly. However there are timeouts reported for 0.94 builds on the EC2 jenkins, this is why I want to get the HBASE-8303 patch in on 0.94 today.
          Hide
          stack added a comment -

          Marking closed.

          Show
          stack added a comment - Marking closed.

            People

            • Assignee:
              Nick Dimiduk
              Reporter:
              Nick Dimiduk
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development