Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.2, 2.0.0-alpha, 3.0.0
    • Fix Version/s: 0.23.3, 2.0.2-alpha
    • Component/s: mrv2, nodemanager
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      I have the MAPREDUCE-3862 changes which fixed this issue earlier and "yarn.nodemanager.delete.debug-delay-sec" set to default value but still getting this issue.

      1. nm-threaddump.out
        61 kB
        Devaraj K
      2. MAPREDUCE-4031.patch
        3 kB
        Devaraj K
      3. MAPREDUCE-4031.patch
        3 kB
        Siddharth Seth
      4. MAPREDUCE-4031.patch
        3 kB
        Devaraj K
      5. MAPREDUCE-4031.patch
        3 kB
        Siddharth Seth
      6. MAPREDUCE-4031.patch
        3 kB
        Siddharth Seth

        Activity

        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Build #304 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/304/)
        svn merge -c 1353038 FIXES: MAPREDUCE-4031. Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K) (Revision 1356977)

        Result = SUCCESS
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1356977
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ShutdownHookManager.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/event/AsyncDispatcher.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #304 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/304/ ) svn merge -c 1353038 FIXES: MAPREDUCE-4031 . Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K) (Revision 1356977) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1356977 Files : /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ShutdownHookManager.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/event/AsyncDispatcher.java
        Hide
        Devaraj K added a comment -

        Thanks a lot Sid for reviewing and committing the patch.

        Show
        Devaraj K added a comment - Thanks a lot Sid for reviewing and committing the patch.
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #1118 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1118/)
        MAPREDUCE-4031 amendment. Fixes CHANGES.txt to reflect correct fix version. (Revision 1353039)
        MAPREDUCE-4031. Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K) (Revision 1353038)

        Result = FAILURE
        sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353039
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt

        sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353038
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ShutdownHookManager.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/event/AsyncDispatcher.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #1118 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1118/ ) MAPREDUCE-4031 amendment. Fixes CHANGES.txt to reflect correct fix version. (Revision 1353039) MAPREDUCE-4031 . Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K) (Revision 1353038) Result = FAILURE sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353039 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353038 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ShutdownHookManager.java /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/event/AsyncDispatcher.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #1085 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1085/)
        MAPREDUCE-4031 amendment. Fixes CHANGES.txt to reflect correct fix version. (Revision 1353039)
        MAPREDUCE-4031. Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K) (Revision 1353038)

        Result = FAILURE
        sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353039
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt

        sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353038
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ShutdownHookManager.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/event/AsyncDispatcher.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #1085 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1085/ ) MAPREDUCE-4031 amendment. Fixes CHANGES.txt to reflect correct fix version. (Revision 1353039) MAPREDUCE-4031 . Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K) (Revision 1353038) Result = FAILURE sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353039 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353038 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ShutdownHookManager.java /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/event/AsyncDispatcher.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #2399 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2399/)
        MAPREDUCE-4031 amendment. Fixes CHANGES.txt to reflect correct fix version. (Revision 1353039)

        Result = FAILURE
        sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353039
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #2399 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2399/ ) MAPREDUCE-4031 amendment. Fixes CHANGES.txt to reflect correct fix version. (Revision 1353039) Result = FAILURE sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353039 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #2398 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2398/)
        MAPREDUCE-4031. Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K) (Revision 1353038)

        Result = FAILURE
        sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353038
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ShutdownHookManager.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/event/AsyncDispatcher.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #2398 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2398/ ) MAPREDUCE-4031 . Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K) (Revision 1353038) Result = FAILURE sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353038 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ShutdownHookManager.java /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/event/AsyncDispatcher.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #2450 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2450/)
        MAPREDUCE-4031 amendment. Fixes CHANGES.txt to reflect correct fix version. (Revision 1353039)

        Result = SUCCESS
        sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353039
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #2450 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2450/ ) MAPREDUCE-4031 amendment. Fixes CHANGES.txt to reflect correct fix version. (Revision 1353039) Result = SUCCESS sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353039 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #2449 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2449/)
        MAPREDUCE-4031. Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K) (Revision 1353038)

        Result = SUCCESS
        sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353038
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ShutdownHookManager.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/event/AsyncDispatcher.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #2449 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2449/ ) MAPREDUCE-4031 . Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K) (Revision 1353038) Result = SUCCESS sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353038 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ShutdownHookManager.java /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/event/AsyncDispatcher.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #2380 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2380/)
        MAPREDUCE-4031 amendment. Fixes CHANGES.txt to reflect correct fix version. (Revision 1353039)

        Result = SUCCESS
        sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353039
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #2380 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2380/ ) MAPREDUCE-4031 amendment. Fixes CHANGES.txt to reflect correct fix version. (Revision 1353039) Result = SUCCESS sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353039 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #2379 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2379/)
        MAPREDUCE-4031. Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K) (Revision 1353038)

        Result = SUCCESS
        sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353038
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ShutdownHookManager.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/event/AsyncDispatcher.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #2379 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2379/ ) MAPREDUCE-4031 . Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K) (Revision 1353038) Result = SUCCESS sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1353038 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ShutdownHookManager.java /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/event/AsyncDispatcher.java
        Hide
        Siddharth Seth added a comment -

        Committed to trunk and branch-2. Thanks Devaraj.

        Show
        Siddharth Seth added a comment - Committed to trunk and branch-2. Thanks Devaraj.
        Hide
        Siddharth Seth added a comment -

        +1. The test failures aren't related. Committing this.

        Show
        Siddharth Seth added a comment - +1. The test failures aren't related. Committing this.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12532916/MAPREDUCE-4031.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        -1 javadoc. The javadoc tool appears to have generated 13 warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common:

        org.apache.hadoop.io.file.tfile.TestTFileJClassComparatorByteArrays
        org.apache.hadoop.io.file.tfile.TestTFileByteArrays

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2492//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2492//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12532916/MAPREDUCE-4031.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac. The applied patch does not increase the total number of javac compiler warnings. -1 javadoc. The javadoc tool appears to have generated 13 warning messages. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common: org.apache.hadoop.io.file.tfile.TestTFileJClassComparatorByteArrays org.apache.hadoop.io.file.tfile.TestTFileByteArrays +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2492//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2492//console This message is automatically generated.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12532607/MAPREDUCE-4031.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        -1 javac. The patch appears to cause the build to fail.

        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2477//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12532607/MAPREDUCE-4031.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. -1 javac. The patch appears to cause the build to fail. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2477//console This message is automatically generated.
        Hide
        Siddharth Seth added a comment -

        The test failures to seem unrelated... uploading once more for Jenkins.

        Show
        Siddharth Seth added a comment - The test failures to seem unrelated... uploading once more for Jenkins.
        Hide
        Devaraj K added a comment -

        Thanks a lot Sid for looking into the patch.

        The above test failures are not related to the patch. Resubmitting the same patch to trigger Jenkins.

        Show
        Devaraj K added a comment - Thanks a lot Sid for looking into the patch. The above test failures are not related to the patch. Resubmitting the same patch to trigger Jenkins.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12532268/MAPREDUCE-4031.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common:

        org.apache.hadoop.io.file.tfile.TestTFileByteArrays
        org.apache.hadoop.io.file.tfile.TestTFileJClassComparatorByteArrays
        org.apache.hadoop.fs.viewfs.TestViewFsTrash

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2464//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2464//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12532268/MAPREDUCE-4031.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 javadoc. The javadoc tool did not generate any warning messages. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common: org.apache.hadoop.io.file.tfile.TestTFileByteArrays org.apache.hadoop.io.file.tfile.TestTFileJClassComparatorByteArrays org.apache.hadoop.fs.viewfs.TestViewFsTrash +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2464//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2464//console This message is automatically generated.
        Hide
        Siddharth Seth added a comment -

        Changes look good to me. Re-uploading the patch for Jenkins.

        Show
        Siddharth Seth added a comment - Changes look good to me. Re-uploading the patch for Jenkins.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12526006/MAPREDUCE-4031.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        -1 findbugs. The patch appears to cause Findbugs (version 1.3.9) to fail.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common:

        org.apache.hadoop.fs.viewfs.TestViewFsTrash

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2370//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2370//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12526006/MAPREDUCE-4031.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. -1 findbugs. The patch appears to cause Findbugs (version 1.3.9) to fail. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common: org.apache.hadoop.fs.viewfs.TestViewFsTrash +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2370//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2370//console This message is automatically generated.
        Hide
        Devaraj K added a comment -

        I am attaching first level patch for review. Here changes involve in common also, I have added in this patch itself for review.

        Show
        Devaraj K added a comment - I am attaching first level patch for review. Here changes involve in common also, I have added in this patch itself for review.
        Hide
        Devaraj K added a comment -

        When we do NM shutdown, as part of NM shutdown, it acquires the class lock on java.lang.Shutdown and starts executing shut down hook for NM. It invokes the nm.stop() and which will stop all the other services. When it tries to stop AsyncDispatcher, AsyncDispatcher will wait for eventHandlingThread to join. After starts executing shutdown hook and before come to wait for join on eventHandlingThread, if any exception occurs on eventHandlingThread, it will execute System.exit() in the catch block. This system.exit() in catch tries to acquire class lock java.lang.Shutdown which was holding by shutdown hook thread and waits forever. Shutdown hook thread also waits forever to join eventHandlingThread.

        Show
        Devaraj K added a comment - When we do NM shutdown, as part of NM shutdown, it acquires the class lock on java.lang.Shutdown and starts executing shut down hook for NM. It invokes the nm.stop() and which will stop all the other services. When it tries to stop AsyncDispatcher, AsyncDispatcher will wait for eventHandlingThread to join. After starts executing shutdown hook and before come to wait for join on eventHandlingThread, if any exception occurs on eventHandlingThread, it will execute System.exit() in the catch block. This system.exit() in catch tries to acquire class lock java.lang.Shutdown which was holding by shutdown hook thread and waits forever. Shutdown hook thread also waits forever to join eventHandlingThread.
        Hide
        Devaraj K added a comment -

        I am attaching the NM process thread dump for this issue.

        Show
        Devaraj K added a comment - I am attaching the NM process thread dump for this issue.

          People

          • Assignee:
            Devaraj K
            Reporter:
            Devaraj K
          • Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development