Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3355

AM scheduling hangs frequently with sort job on 350 nodes

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.1
    • Component/s: applicationmaster, mrv2
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly.

      Description

      Another collaboration with Karam Singh. Sort job hangs not so rarely on a 350 node cluster. Found this in AM logs:

      
      Exception in thread "ContainerLauncher #60" org.apache.hadoop.yarn.YarnException: java.lang.InterruptedException
                  at org.apache.hadoop.yarn.event.AsyncDispatcher$GenericEventHandler.handle(AsyncDispatcher.java:170)
                  at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:379)
                  at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
                  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
                  at java.lang.Thread.run(Thread.java:619)
      Caused by: java.lang.InterruptedException
                  at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1199)
                  at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:312)
                  at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:294)
                  at org.apache.hadoop.yarn.event.AsyncDispatcher$GenericEventHandler.handle(AsyncDispatcher.java:168)
                  ... 4 more
      
      Exception in thread "ContainerLauncher #53" org.apache.hadoop.yarn.YarnException: java.lang.InterruptedException
                  at org.apache.hadoop.yarn.event.AsyncDispatcher$GenericEventHandler.handle(AsyncDispatcher.java:170)
                  at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl.sendContainerLaunchFailedMsg(ContainerLauncherImpl.java:405)
                  at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:330)
                  at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
                  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
                  at java.lang.Thread.run(Thread.java:619)
      Caused by: java.lang.InterruptedException
                  at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1199)
                  at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:312)
                  at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:294)
                  at org.apache.hadoop.yarn.event.AsyncDispatcher$GenericEventHandler.handle(AsyncDispatcher.java:168)
                  ... 5 more
      
      1. MR3355.txt
        10 kB
        Siddharth Seth
      2. MAPREDUCE-3355-20111115.txt
        10 kB
        Vinod Kumar Vavilapalli
      3. MAPREDUCE-3355-20111109.1.txt
        8 kB
        Vinod Kumar Vavilapalli
      4. MAPREDUCE-3355-20111109.txt
        8 kB
        Vinod Kumar Vavilapalli

        Issue Links

          Activity

          Hide
          Vinod Kumar Vavilapalli added a comment -

          MAPREDUCE-3333 touches related code, marking that as a dependent ticket.

          Show
          Vinod Kumar Vavilapalli added a comment - MAPREDUCE-3333 touches related code, marking that as a dependent ticket.
          Hide
          Vinod Kumar Vavilapalli added a comment -

          This should fix it. It works by clearing the interrupt status so that event handling can continue to work and report failures etc.

          Will make it PA once MAPREDUCE-3333 is in.

          Show
          Vinod Kumar Vavilapalli added a comment - This should fix it. It works by clearing the interrupt status so that event handling can continue to work and report failures etc. Will make it PA once MAPREDUCE-3333 is in.
          Hide
          Karam Singh added a comment -

          After patch over MAPREDUCE-3333, Ran Sort twice and did not observe this issue anymore

          Show
          Karam Singh added a comment - After patch over MAPREDUCE-3333 , Ran Sort twice and did not observe this issue anymore
          Hide
          Vinod Kumar Vavilapalli added a comment -

          After patch over MAPREDUCE-3333, Ran Sort twice and did not observe this issue anymore

          Thanks Karam!

          Submitting this to Jenkins.

          Show
          Vinod Kumar Vavilapalli added a comment - After patch over MAPREDUCE-3333 , Ran Sort twice and did not observe this issue anymore Thanks Karam! Submitting this to Jenkins.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12503035/MAPREDUCE-3355-20111109.txt
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 3 new or modified tests.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1282//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12503035/MAPREDUCE-3355-20111109.txt against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1282//console This message is automatically generated.
          Hide
          Vinod Kumar Vavilapalli added a comment -

          Few imports clashed and made the patch invalid.

          Same patch that Karam tested but with fixed imports.

          Show
          Vinod Kumar Vavilapalli added a comment - Few imports clashed and made the patch invalid. Same patch that Karam tested but with fixed imports.
          Hide
          Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12503093/MAPREDUCE-3355-20111109.1.txt
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 3 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in .

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1283//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1283//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12503093/MAPREDUCE-3355-20111109.1.txt against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1283//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1283//console This message is automatically generated.
          Hide
          Siddharth Seth added a comment -

          There's another extremely unlikely situation which could cause this.
          Canceling the timer doesn't affect the timer task if it's already started. An interrupt could come in anytime after the cancel - which could interrupt the TA_CONTAINER_CLEANED event or the ContainerLaunchedEvent. This would be a combination of startContainer finishing around when the timer expires + some very specific thread scheduling. Also if the start/stopContainer were to complete around the same time as when the timer kicks in.
          Possible fix would be to synchronize in the main task on the CommandTimer when we don't care about interrupts, and always synchronize the CommandTimer on itself.

          Show
          Siddharth Seth added a comment - There's another extremely unlikely situation which could cause this. Canceling the timer doesn't affect the timer task if it's already started. An interrupt could come in anytime after the cancel - which could interrupt the TA_CONTAINER_CLEANED event or the ContainerLaunchedEvent. This would be a combination of startContainer finishing around when the timer expires + some very specific thread scheduling. Also if the start/stopContainer were to complete around the same time as when the timer kicks in. Possible fix would be to synchronize in the main task on the CommandTimer when we don't care about interrupts, and always synchronize the CommandTimer on itself.
          Hide
          Vinod Kumar Vavilapalli added a comment -

          There's another extremely unlikely situation which could cause this.

          However unlikely it is, it'll be good if we can fix it. I'll see what I can do.

          Show
          Vinod Kumar Vavilapalli added a comment - There's another extremely unlikely situation which could cause this. However unlikely it is, it'll be good if we can fix it. I'll see what I can do.
          Hide
          Vinod Kumar Vavilapalli added a comment -

          Updated patch that should avoid the race condition reported by Sid.

          • Removed one Timer per launch, that's one more thread for every event!
          • Cancelling each TimerTask explicitly.
          Show
          Vinod Kumar Vavilapalli added a comment - Updated patch that should avoid the race condition reported by Sid. Removed one Timer per launch, that's one more thread for every event! Cancelling each TimerTask explicitly.
          Hide
          Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12503729/MAPREDUCE-3355-20111115.txt
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 3 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in .

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1307//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1307//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12503729/MAPREDUCE-3355-20111115.txt against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1307//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1307//console This message is automatically generated.
          Hide
          Siddharth Seth added a comment -

          Thanks.. Looks good, except one more interrupt check required after timer.cancel() while handling the CLEANUP event. Updating the patch with this minor change.

          Show
          Siddharth Seth added a comment - Thanks.. Looks good, except one more interrupt check required after timer.cancel() while handling the CLEANUP event. Updating the patch with this minor change.
          Hide
          Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12503813/MR3355.txt
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 3 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in .

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1309//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1309//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12503813/MR3355.txt against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1309//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1309//console This message is automatically generated.
          Hide
          Vinod Kumar Vavilapalli added a comment -

          Thanks for the update, Sid. I am fine with those changes.

          Show
          Vinod Kumar Vavilapalli added a comment - Thanks for the update, Sid. I am fine with those changes.
          Hide
          Vinod Kumar Vavilapalli added a comment -

          I just committed this to trunk and branch-0.23.

          Show
          Vinod Kumar Vavilapalli added a comment - I just committed this to trunk and branch-0.23.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-0.23-Commit #173 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/173/)
          MAPREDUCE-3355. Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv)
          svn merge -c r1202744 --ignore-ancestry ../../trunk/

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202745
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #173 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/173/ ) MAPREDUCE-3355 . Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv) svn merge -c r1202744 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202745 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk-Commit #1276 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1276/)
          MAPREDUCE-3355. Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv)

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202744
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1276 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1276/ ) MAPREDUCE-3355 . Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv) vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202744 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #1350 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1350/)
          MAPREDUCE-3355. Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv)

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202744
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1350 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1350/ ) MAPREDUCE-3355 . Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv) vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202744 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-0.23-Commit #174 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/174/)
          MAPREDUCE-3355. Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv)
          svn merge -c r1202744 --ignore-ancestry ../../trunk/

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202745
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Show
          Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #174 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/174/ ) MAPREDUCE-3355 . Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv) svn merge -c r1202744 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202745 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-0.23-Commit #186 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/186/)
          MAPREDUCE-3355. Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv)
          svn merge -c r1202744 --ignore-ancestry ../../trunk/

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202745
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #186 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/186/ ) MAPREDUCE-3355 . Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv) svn merge -c r1202744 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202745 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #1300 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1300/)
          MAPREDUCE-3355. Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv)

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202744
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1300 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1300/ ) MAPREDUCE-3355 . Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv) vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202744 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #866 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/866/)
          MAPREDUCE-3355. Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv)

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202744
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #866 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/866/ ) MAPREDUCE-3355 . Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv) vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202744 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-0.23-Build #96 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/96/)
          MAPREDUCE-3355. Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv)
          svn merge -c r1202744 --ignore-ancestry ../../trunk/

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202745
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #96 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/96/ ) MAPREDUCE-3355 . Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv) svn merge -c r1202744 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202745 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #900 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/900/)
          MAPREDUCE-3355. Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv)

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202744
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #900 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/900/ ) MAPREDUCE-3355 . Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv) vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202744 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-0.23-Build #79 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/79/)
          MAPREDUCE-3355. Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv)
          svn merge -c r1202744 --ignore-ancestry ../../trunk/

          vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202745
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java
          • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #79 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/79/ ) MAPREDUCE-3355 . Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv) svn merge -c r1202744 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202745 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/launcher/ContainerLauncherImpl.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestContainerLauncher.java

            People

            • Assignee:
              Vinod Kumar Vavilapalli
              Reporter:
              Vinod Kumar Vavilapalli
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development