Details

    • Type: Test Test
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0, 0.23.1
    • Fix Version/s: 0.23.2
    • Component/s: test
    • Labels:
    • Target Version/s:
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build.

      Description

      File <somepath>/hadoop-mapreduce-project/build/test/data/test-job-cleanup/output-8/_custom_cleanup missing for job job_20120203035807432_0009

      junit.framework.AssertionFailedError: File <somepath>/hadoop-mapreduce-project/build/test/data/test-job-cleanup/output-8/_custom_cleanup missing for job job_20120203035807432_0009
      at org.apache.hadoop.mapred.TestJobCleanup.testKilledJob(TestJobCleanup.java:228)
      at org.apache.hadoop.mapred.TestJobCleanup.testCustomCleanup(TestJobCleanup.java:302)
      at junit.extensions.TestDecorator.basicRun(TestDecorator.java:24)
      at junit.extensions.TestSetup$1.protect(TestSetup.java:23)
      at junit.extensions.TestSetup.run(TestSetup.java:27)

      1. MAPREDUCE-3798.patch
        25 kB
        Ravi Prakash
      2. MAPREDUCE-3798.patch
        25 kB
        Ravi Prakash
      3. MAPREDUCE-3798.patch
        25 kB
        Vinod Kumar Vavilapalli

        Activity

        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Build #204 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/204/)
        MAPREDUCE-3798. Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash.
        svn merge --ignore-ancestry -c 1291606 ../../trunk (Revision 1291607)

        Result = FAILURE
        vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291607
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #204 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/204/ ) MAPREDUCE-3798 . Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash. svn merge --ignore-ancestry -c 1291606 ../../trunk (Revision 1291607) Result = FAILURE vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291607 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #998 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/998/)
        MAPREDUCE-3798. Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash. (Revision 1291606)

        Result = SUCCESS
        vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291606
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #998 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/998/ ) MAPREDUCE-3798 . Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash. (Revision 1291606) Result = SUCCESS vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291606 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #962 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/962/)
        MAPREDUCE-3798. Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash. (Revision 1291606)

        Result = FAILURE
        vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291606
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #962 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/962/ ) MAPREDUCE-3798 . Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash. (Revision 1291606) Result = FAILURE vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291606 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Build #175 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/175/)
        MAPREDUCE-3798. Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash.
        svn merge --ignore-ancestry -c 1291606 ../../trunk (Revision 1291607)

        Result = FAILURE
        vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291607
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #175 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/175/ ) MAPREDUCE-3798 . Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash. svn merge --ignore-ancestry -c 1291606 ../../trunk (Revision 1291607) Result = FAILURE vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291607 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #1771 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1771/)
        MAPREDUCE-3798. Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash. (Revision 1291606)

        Result = ABORTED
        vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291606
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1771 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1771/ ) MAPREDUCE-3798 . Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash. (Revision 1291606) Result = ABORTED vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291606 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Commit #582 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/582/)
        MAPREDUCE-3798. Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash.
        svn merge --ignore-ancestry -c 1291606 ../../trunk (Revision 1291607)

        Result = ABORTED
        vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291607
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #582 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/582/ ) MAPREDUCE-3798 . Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash. svn merge --ignore-ancestry -c 1291606 ../../trunk (Revision 1291607) Result = ABORTED vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291607 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-0.23-Commit #580 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/580/)
        MAPREDUCE-3798. Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash.
        svn merge --ignore-ancestry -c 1291606 ../../trunk (Revision 1291607)

        Result = SUCCESS
        vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291607
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #580 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/580/ ) MAPREDUCE-3798 . Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash. svn merge --ignore-ancestry -c 1291606 ../../trunk (Revision 1291607) Result = SUCCESS vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291607 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Commit #567 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/567/)
        MAPREDUCE-3798. Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash.
        svn merge --ignore-ancestry -c 1291606 ../../trunk (Revision 1291607)

        Result = SUCCESS
        vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291607
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #567 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/567/ ) MAPREDUCE-3798 . Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash. svn merge --ignore-ancestry -c 1291606 ../../trunk (Revision 1291607) Result = SUCCESS vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291607 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #1760 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1760/)
        MAPREDUCE-3798. Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash. (Revision 1291606)

        Result = SUCCESS
        vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291606
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1760 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1760/ ) MAPREDUCE-3798 . Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash. (Revision 1291606) Result = SUCCESS vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291606 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #1834 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1834/)
        MAPREDUCE-3798. Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash. (Revision 1291606)

        Result = SUCCESS
        vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291606
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1834 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1834/ ) MAPREDUCE-3798 . Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash. (Revision 1291606) Result = SUCCESS vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1291606 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestJobCleanup.java /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobCleanup.java
        Hide
        Vinod Kumar Vavilapalli added a comment -

        I just committed this to trunk and branch-0.23. Thanks Ravi Prakash!

        Show
        Vinod Kumar Vavilapalli added a comment - I just committed this to trunk and branch-0.23. Thanks Ravi Prakash!
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12515209/MAPREDUCE-3798.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 4 new or modified tests.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        -1 javac. The applied patch generated 508 javac compiler warnings (more than the trunk's current 507 warnings).

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1900//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1900//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12515209/MAPREDUCE-3798.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 4 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. -1 javac. The applied patch generated 508 javac compiler warnings (more than the trunk's current 507 warnings). +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1900//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1900//console This message is automatically generated.
        Hide
        Vinod Kumar Vavilapalli added a comment -

        TestIndexCache can indeed fail in very corner cases. Will reattach the same patch and resubmit.

        Show
        Vinod Kumar Vavilapalli added a comment - TestIndexCache can indeed fail in very corner cases. Will reattach the same patch and resubmit.
        Hide
        Ravi Prakash added a comment -

        The single javac warning is because I am using MiniMRCluster which is now deprecated in MRv2. The test file I migrated had been using MRv1 in which MiniMRCluster had not been deprecated (hence the increment in warnings I guess). I tried different things with @SuppressWarnings annotation but wasn't able to get rid of the one warning.

        The core test failure has nothing to do with this patch (I am not changing any src/main code)

        Can someone please commit this in 0.23.1, 0.23 and trunk?

        Show
        Ravi Prakash added a comment - The single javac warning is because I am using MiniMRCluster which is now deprecated in MRv2. The test file I migrated had been using MRv1 in which MiniMRCluster had not been deprecated (hence the increment in warnings I guess). I tried different things with @SuppressWarnings annotation but wasn't able to get rid of the one warning. The core test failure has nothing to do with this patch (I am not changing any src/main code) Can someone please commit this in 0.23.1, 0.23 and trunk?
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12514658/MAPREDUCE-3798.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 4 new or modified tests.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        -1 javac. The applied patch generated 508 javac compiler warnings (more than the trunk's current 507 warnings).

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests:
        org.apache.hadoop.mapred.TestIndexCache

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1863//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1863//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12514658/MAPREDUCE-3798.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 4 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. -1 javac. The applied patch generated 508 javac compiler warnings (more than the trunk's current 507 warnings). +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests: org.apache.hadoop.mapred.TestIndexCache +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1863//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1863//console This message is automatically generated.
        Hide
        Ravi Prakash added a comment -

        Suppressing the javac warnings due to the usage of MiniMRCluster

        Show
        Ravi Prakash added a comment - Suppressing the javac warnings due to the usage of MiniMRCluster
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12514651/MAPREDUCE-3798.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 4 new or modified tests.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        -1 javac. The applied patch generated 510 javac compiler warnings (more than the trunk's current 507 warnings).

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1862//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1862//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12514651/MAPREDUCE-3798.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 4 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. -1 javac. The applied patch generated 510 javac compiler warnings (more than the trunk's current 507 warnings). +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1862//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1862//console This message is automatically generated.
        Hide
        Ravi Prakash added a comment -

        The same patch also applies to trunk.

        Show
        Ravi Prakash added a comment - The same patch also applies to trunk.
        Hide
        Ravi Prakash added a comment -

        Sneaking in a change in documentation that I missed earlier =D.

        Show
        Ravi Prakash added a comment - Sneaking in a change in documentation that I missed earlier =D.
        Hide
        Ravi Prakash added a comment -

        I've ported the test to run from mvn builds. The problem was essentially two confs that needed to be set now in the tests:

        conf.set(JHAdminConfig.MR_HISTORY_INTERMEDIATE_DONE_DIR, TEST_ROOT_DIR +
              "/intermediate");   conf.set(org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
              .SUCCESSFUL_JOB_OUTPUT_DIR_MARKER, "true");
        

        And also that FileOutputCommitter had been modified in the JIRA's Bobby mentioned.

        Show
        Ravi Prakash added a comment - I've ported the test to run from mvn builds. The problem was essentially two confs that needed to be set now in the tests: conf.set(JHAdminConfig.MR_HISTORY_INTERMEDIATE_DONE_DIR, TEST_ROOT_DIR + "/intermediate"); conf.set(org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter .SUCCESSFUL_JOB_OUTPUT_DIR_MARKER, "true"); And also that FileOutputCommitter had been modified in the JIRA's Bobby mentioned.
        Hide
        Robert Joseph Evans added a comment -

        There were some changes that I put into the FileOutputCommitter to fix a bug there MAPREDUCE-3711 and MAPREDUCE-3808. One or both of them may have broken the CommitterWithCustomDeprecatedClenup. Some of the directory structure changed.

        Show
        Robert Joseph Evans added a comment - There were some changes that I put into the FileOutputCommitter to fix a bug there MAPREDUCE-3711 and MAPREDUCE-3808 . One or both of them may have broken the CommitterWithCustomDeprecatedClenup. Some of the directory structure changed.
        Hide
        Ravi Prakash added a comment -

        Seems like the CommitterWithCustomDeprecatedCleanup (which extends FileOutputCommitter) is not being run, even though it is specified in the JobConf

        Show
        Ravi Prakash added a comment - Seems like the CommitterWithCustomDeprecatedCleanup (which extends FileOutputCommitter) is not being run, even though it is specified in the JobConf
        Hide
        Ravi Prakash added a comment -

        Dunno if its relevant but I see these in the logs

        2012-02-03 04:01:24,992 WARN  [Thread-519] mapred.TaskRunner (TaskRunner.java:run(224)) - attempt_20120203035807432_0009_m_000001_3 : Child Error
        java.io.IOException: Task process exit with nonzero status of 1.
        	at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:212)
        2012-02-03 04:01:25,029 INFO  [IPC Server handler 0 on 38926] mapred.TaskInProgress (TaskInProgress.java:updateStatus(672)) - Error from attempt_20120203035807432_0009_m_000001_3 on tracker_host0.foo.com:localhost/127.0.0.1:58634: java.lang.Throwable: Child Error
        	at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:225)
        Caused by: java.io.IOException: Task process exit with nonzero status of 1.
        	at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:212)
        

        and

        2012-02-03 04:01:32,638 ERROR [Thread-38] mapred.TaskTracker (TaskTracker.java:offerService(1603)) - Caught exception: java.io.IOException: Jetty problem. Jetty didn't bind to a valid port
        	at org.apache.hadoop.mapred.TaskTracker.checkJettyPort(TaskTracker.java:1408)
        	at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:1581)
        	at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:2444)
        	at org.apache.hadoop.mapred.MiniMRCluster$TaskTrackerRunner.run(MiniMRCluster.java:229)
        	at java.lang.Thread.run(Thread.java:662)
        
        Show
        Ravi Prakash added a comment - Dunno if its relevant but I see these in the logs 2012-02-03 04:01:24,992 WARN [Thread-519] mapred.TaskRunner (TaskRunner.java:run(224)) - attempt_20120203035807432_0009_m_000001_3 : Child Error java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:212) 2012-02-03 04:01:25,029 INFO [IPC Server handler 0 on 38926] mapred.TaskInProgress (TaskInProgress.java:updateStatus(672)) - Error from attempt_20120203035807432_0009_m_000001_3 on tracker_host0.foo.com:localhost/127.0.0.1:58634: java.lang.Throwable: Child Error at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:225) Caused by: java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:212) and 2012-02-03 04:01:32,638 ERROR [Thread-38] mapred.TaskTracker (TaskTracker.java:offerService(1603)) - Caught exception: java.io.IOException: Jetty problem. Jetty didn't bind to a valid port at org.apache.hadoop.mapred.TaskTracker.checkJettyPort(TaskTracker.java:1408) at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:1581) at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:2444) at org.apache.hadoop.mapred.MiniMRCluster$TaskTrackerRunner.run(MiniMRCluster.java:229) at java.lang.Thread.run(Thread.java:662)

          People

          • Assignee:
            Ravi Prakash
            Reporter:
            Ravi Prakash
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development