Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3345

Race condition in ResourceManager causing TestContainerManagerSecurity to fail sometimes

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.1
    • Component/s: mrv2, resourcemanager
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes.

      Activity

      Hide
      Hudson added a comment -

      Integrated in Hadoop-Mapreduce-trunk #891 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/891/)
      MAPREDUCE-3345. Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah.

      vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199144
      Files :

      • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
      • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Show
      Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #891 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/891/ ) MAPREDUCE-3345 . Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah. vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199144 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Hdfs-trunk #857 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/857/)
      MAPREDUCE-3345. Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah.

      vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199144
      Files :

      • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
      • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Show
      Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #857 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/857/ ) MAPREDUCE-3345 . Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah. vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199144 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Hdfs-0.23-Build #70 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/70/)
      MAPREDUCE-3345. Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah.
      svn merge -c r1199144 --ignore-ancestry ../../trunk/

      vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199145
      Files :

      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Show
      Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #70 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/70/ ) MAPREDUCE-3345 . Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah. svn merge -c r1199144 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199145 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Mapreduce-trunk-Commit #1279 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1279/)
      MAPREDUCE-3345. Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah.

      vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199144
      Files :

      • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
      • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Show
      Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1279 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1279/ ) MAPREDUCE-3345 . Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah. vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199144 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Mapreduce-0.23-Commit #167 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/167/)
      MAPREDUCE-3345. Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah.
      svn merge -c r1199144 --ignore-ancestry ../../trunk/

      vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199145
      Files :

      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Show
      Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #167 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/167/ ) MAPREDUCE-3345 . Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah. svn merge -c r1199144 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199145 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Mapreduce-0.23-Build #84 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/84/)
      MAPREDUCE-3345. Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah.
      svn merge -c r1199144 --ignore-ancestry ../../trunk/

      vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199145
      Files :

      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Show
      Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #84 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/84/ ) MAPREDUCE-3345 . Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah. svn merge -c r1199144 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199145 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Hdfs-trunk-Commit #1331 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1331/)
      MAPREDUCE-3345. Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah.

      vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199144
      Files :

      • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
      • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Show
      Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1331 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1331/ ) MAPREDUCE-3345 . Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah. vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199144 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Hdfs-0.23-Commit #155 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/155/)
      MAPREDUCE-3345. Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah.
      svn merge -c r1199144 --ignore-ancestry ../../trunk/

      vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199145
      Files :

      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Show
      Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #155 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/155/ ) MAPREDUCE-3345 . Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah. svn merge -c r1199144 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199145 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Common-trunk-Commit #1257 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1257/)
      MAPREDUCE-3345. Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah.

      vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199144
      Files :

      • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
      • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Show
      Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1257 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1257/ ) MAPREDUCE-3345 . Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah. vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199144 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Common-0.23-Commit #156 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/156/)
      MAPREDUCE-3345. Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah.
      svn merge -c r1199144 --ignore-ancestry ../../trunk/

      vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199145
      Files :

      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
      • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Show
      Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #156 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/156/ ) MAPREDUCE-3345 . Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah. svn merge -c r1199144 --ignore-ancestry ../../trunk/ vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199145 Files : /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java
      Hide
      Vinod Kumar Vavilapalli added a comment -

      I just committed this to trunk and branch-0.23. Thanks Hitesh!

      Show
      Vinod Kumar Vavilapalli added a comment - I just committed this to trunk and branch-0.23. Thanks Hitesh!
      Hide
      Vinod Kumar Vavilapalli added a comment -

      I was wondering how to fix this till I saw your patch.

      Patch is inline with my understanding of the race condition.

      I'm fine with not having a test for this race. +1 for the patch.

      Show
      Vinod Kumar Vavilapalli added a comment - I was wondering how to fix this till I saw your patch. Patch is inline with my understanding of the race condition. I'm fine with not having a test for this race. +1 for the patch.
      Hide
      Hadoop QA added a comment -

      -1 overall. Here are the results of testing the latest attachment
      http://issues.apache.org/jira/secure/attachment/12502834/MR-3345.1.patch
      against trunk revision .

      +1 @author. The patch does not contain any @author tags.

      -1 tests included. The patch doesn't appear to include any new or modified tests.
      Please justify why no new tests are needed for this patch.
      Also please list what manual steps were performed to verify this patch.

      +1 javadoc. The javadoc tool did not generate any warning messages.

      +1 javac. The applied patch does not increase the total number of javac compiler warnings.

      +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

      +1 release audit. The applied patch does not increase the total number of release audit warnings.

      +1 core tests. The patch passed unit tests in .

      +1 contrib tests. The patch passed contrib unit tests.

      Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1262//testReport/
      Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1262//console

      This message is automatically generated.

      Show
      Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12502834/MR-3345.1.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1262//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1262//console This message is automatically generated.
      Hide
      Hitesh Shah added a comment -

      No tests - trivial fix. Running failing test in a loop for over an hour now with no failures.

      Show
      Hitesh Shah added a comment - No tests - trivial fix. Running failing test in a loop for over an hour now with no failures.
      Hide
      Hitesh Shah added a comment -

      Debug logs seem to be point to a container being allocated for the AM in RMAppAttemptImpl#ScheduleTransition itself ( when transitioning from SUBMITTED -> SCHEDULED ) which results in no allocated containers in the response when allocate is called subsequently in AMContainerAllocatedTransition.

      FifoScheduler ( unlike Capacity scheduler ) does not have a synchronized block in Scheduler#allocate per application which have otherwise prevented the above from happening.

      Show
      Hitesh Shah added a comment - Debug logs seem to be point to a container being allocated for the AM in RMAppAttemptImpl#ScheduleTransition itself ( when transitioning from SUBMITTED -> SCHEDULED ) which results in no allocated containers in the response when allocate is called subsequently in AMContainerAllocatedTransition. FifoScheduler ( unlike Capacity scheduler ) does not have a synchronized block in Scheduler#allocate per application which have otherwise prevented the above from happening.
      Hide
      Vinod Kumar Vavilapalli added a comment -

      Copying pasting the test-logs just in case Jenkins deletes them.

      {2011-11-03 07:09:07,511 INFO  [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(476)) - appattempt_1320304139196_0003_000001 State change from NEW to SUBMITTED
      2011-11-03 07:09:07,512 INFO  [Node Status Updater] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatus(210)) - Sending out status for container: container_id {, app_attempt_id {, application_id {, id: 2, cluster_timestamp: 1320304139196, }, attemptId: 1, }, id: 1, }, state: C_RUNNING, diagnostics: "Container killed by the ApplicationMaster.\n", exit_status: -1000, 
      2011-11-03 07:09:07,511 INFO  [main] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=jenkins	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1320304139196_0003
      2011-11-03 07:09:07,512 INFO  [AsyncDispatcher event handler] rmnode.RMNodeImpl (RMNodeImpl.java:handle(293)) - Processing asf005.sp2.ygridcore.net:44653 of type STATUS_UPDATE
      2011-11-03 07:09:07,512 INFO  [ResourceManager Event Processor] fifo.FifoScheduler (FifoScheduler.java:addApplication(288)) - Application Submission: application_1320304139196_0003 from jenkins, currently active: 1
      2011-11-03 07:09:07,513 INFO  [main] server.TestContainerManagerSecurity (TestContainerManagerSecurity.java:submitAndRegisterApplication(373)) - Waiting for applicationAttempt to be created.. 
      2011-11-03 07:09:07,513 INFO  [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(464)) - Processing event for appattempt_1320304139196_0003_000001 of type APP_ACCEPTED
      2011-11-03 07:09:07,513 INFO  [ResourceManager Event Processor] fifo.FifoScheduler (FifoScheduler.java:nodeUpdate(571)) - Node heartbeat asf005.sp2.ygridcore.net:44653 available resource = memory: 4096
      2011-11-03 07:09:07,515 INFO  [ResourceManager Event Processor] rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(195)) - Processing container_1320304139196_0003_01_000001 of type START
      2011-11-03 07:09:07,515 INFO  [ResourceManager Event Processor] rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(207)) - container_1320304139196_0003_01_000001 Container Transitioned from NEW to ALLOCATED
      2011-11-03 07:09:07,516 INFO  [ResourceManager Event Processor] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=jenkins	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1320304139196_0003	CONTAINERID=container_1320304139196_0003_01_000001
      2011-11-03 07:09:07,516 INFO  [ResourceManager Event Processor] scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(103)) - Assigned container container_1320304139196_0003_01_000001 of capacity memory: 1024 on host asf005.sp2.ygridcore.net:44653, which currently has 1 containers, memory: 1024 used and memory: 3072 available
      2011-11-03 07:09:07,516 INFO  [ResourceManager Event Processor] fifo.FifoScheduler (FifoScheduler.java:nodeUpdate(576)) - Node after allocation asf005.sp2.ygridcore.net:44653 resource = memory: 3072
      2011-11-03 07:09:07,516 INFO  [AsyncDispatcher event handler] rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(195)) - Processing container_1320304139196_0003_01_000001 of type ACQUIRED
      2011-11-03 07:09:07,517 INFO  [AsyncDispatcher event handler] rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(207)) - container_1320304139196_0003_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
      2011-11-03 07:09:07,517 WARN  [ContainersLauncher #0] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(184)) - Exit code from task is : 143
      2011-11-03 07:09:07,517 INFO  [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(476)) - appattempt_1320304139196_0003_000001 State change from SUBMITTED to SCHEDULED
      2011-11-03 07:09:07,517 INFO  [ContainersLauncher #0] nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(154)) - 
      2011-11-03 07:09:07,517 INFO  [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:handle(416)) - Processing event for application_1320304139196_0003 of type APP_ACCEPTED
      2011-11-03 07:09:07,518 INFO  [ContainersLauncher #0] container.Container (ContainerImpl.java:handle(818)) - Processing container_1320304139196_0002_01_000001 of type UPDATE_DIAGNOSTICS_MSG
      2011-11-03 07:09:07,518 INFO  [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:handle(428)) - application_1320304139196_0003 State change from SUBMITTED to ACCEPTED
      2011-11-03 07:09:07,518 INFO  [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(464)) - Processing event for appattempt_1320304139196_0003_000001 of type CONTAINER_ALLOCATED
      2011-11-03 07:09:07,519 ERROR [AsyncDispatcher event handler] resourcemanager.ResourceManager (ResourceManager.java:handle(380)) - Error in handling event type CONTAINER_ALLOCATED for applicationAttempt application_1320304139196_0003
      java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
      	at java.util.ArrayList.RangeCheck(ArrayList.java:547)
      	at java.util.ArrayList.get(ArrayList.java:322)
      	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$AMContainerAllocatedTransition.transition(RMAppAttemptImpl.java:614)
      	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$AMContainerAllocatedTransition.transition(RMAppAttemptImpl.java:603)
      	at org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:357)
      	at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:298)
      	at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:43)
      	at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:443)
      	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:469)
      	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:80)
      	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:378)
      	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:359)
      	at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:116)
      	at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:75)
      	at java.lang.Thread.run(Thread.java:662)
      2011-11-03 07:09:07,519 INFO  [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(464)) - Processing event for appattempt_1320304139196_0003_000001 of type CONTAINER_ACQUIRED
      2011-11-03 07:09:07,520 ERROR [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(471)) - Can't handle this event at current state
      org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: CONTAINER_ACQUIRED at SCHEDULED
      	at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:301)
      	at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:43)
      	at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:443)
      	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:469)
      	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:80)
      	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:378)
      	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:359)
      	at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:116)
      	at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:75)
      	at java.lang.Thread.run(Thread.java:662)
      2011-11-03 07:09:07,526 INFO  [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(818)) - Processing container_1320304139196_0002_01_000001 of type KILL_CONTAINER
      2011-11-03 07:09:07,526 WARN  [AsyncDispatcher event handler] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(495)) - Event EventType: KILL_CONTAINER sent to absent container container_1320304139196_0002_01_000002
      2011-11-03 07:09:07,526 INFO  [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:handle(376)) - Processing application_1320304139196_0002 of type FINISH_APPLICATION
      2011-11-03 07:09:07,526 INFO  [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:handle(387)) - Application application_1320304139196_0002 transitioned from RUNNING to FINISHING_CONTAINERS_WAIT
      2011-11-03 07:09:07,527 INFO  [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(818)) - Processing container_1320304139196_0002_01_000001 of type CONTAINER_KILLED_ON_REQUEST
      2011-11-03 07:09:07,527 INFO  [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(830)) - Container container_1320304139196_0002_01_000001 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
      2011-11-03 07:09:07,527 INFO  [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(818)) - Processing container_1320304139196_0002_01_000001 of type KILL_CONTAINER
      2011-11-03 07:09:07,527 INFO  [AsyncDispatcher event handler] localizer.LocalizedResource (LocalizedResource.java:handle(184)) - Processing file:/home/jenkins/jenkins-slave/workspace/PreCommit-MAPREDUCE-Build/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/target/org.apache.hadoop.yarn.server.TestContainerManagerSecurity-localDir/testFile-application_1320304139196_0002 of type RELEASE
      2011-11-03 07:09:07,528 INFO  [DeletionService #3] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(265)) - Deleting absolute path : /home/jenkins/jenkins-slave/workspace/PreCommit-MAPREDUCE-Build/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/target/org.apache.hadoop.yarn.server.TestContainerManagerSecurity/org.apache.hadoop.yarn.server.TestContainerManagerSecurity-localDir-nm-0/usercache/jenkins/appcache/application_1320304139196_0002/container_1320304139196_0002_01_000001
      2011-11-03 07:09:07,528 INFO  [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(818)) - Processing container_1320304139196_0002_01_000001 of type CONTAINER_RESOURCES_CLEANEDUP
      2011-11-03 07:09:07,528 INFO  [AsyncDispatcher event handler] nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=jenkins	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1320304139196_0002	CONTAINERID=container_1320304139196_0002_01_000001
      2011-11-03 07:09:07,528 INFO  [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(830)) - Container container_1320304139196_0002_01_000001 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
      2011-11-03 07:09:07,529 INFO  [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:handle(376)) - Processing application_1320304139196_0002 of type APPLICATION_CONTAINER_FINISHED
      
      Show
      Vinod Kumar Vavilapalli added a comment - Copying pasting the test-logs just in case Jenkins deletes them. {2011-11-03 07:09:07,511 INFO [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(476)) - appattempt_1320304139196_0003_000001 State change from NEW to SUBMITTED 2011-11-03 07:09:07,512 INFO [Node Status Updater] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatus(210)) - Sending out status for container: container_id {, app_attempt_id {, application_id {, id: 2, cluster_timestamp: 1320304139196, }, attemptId: 1, }, id: 1, }, state: C_RUNNING, diagnostics: "Container killed by the ApplicationMaster.\n" , exit_status: -1000, 2011-11-03 07:09:07,511 INFO [main] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=jenkins OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1320304139196_0003 2011-11-03 07:09:07,512 INFO [AsyncDispatcher event handler] rmnode.RMNodeImpl (RMNodeImpl.java:handle(293)) - Processing asf005.sp2.ygridcore.net:44653 of type STATUS_UPDATE 2011-11-03 07:09:07,512 INFO [ResourceManager Event Processor] fifo.FifoScheduler (FifoScheduler.java:addApplication(288)) - Application Submission: application_1320304139196_0003 from jenkins, currently active: 1 2011-11-03 07:09:07,513 INFO [main] server.TestContainerManagerSecurity (TestContainerManagerSecurity.java:submitAndRegisterApplication(373)) - Waiting for applicationAttempt to be created.. 2011-11-03 07:09:07,513 INFO [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(464)) - Processing event for appattempt_1320304139196_0003_000001 of type APP_ACCEPTED 2011-11-03 07:09:07,513 INFO [ResourceManager Event Processor] fifo.FifoScheduler (FifoScheduler.java:nodeUpdate(571)) - Node heartbeat asf005.sp2.ygridcore.net:44653 available resource = memory: 4096 2011-11-03 07:09:07,515 INFO [ResourceManager Event Processor] rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(195)) - Processing container_1320304139196_0003_01_000001 of type START 2011-11-03 07:09:07,515 INFO [ResourceManager Event Processor] rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(207)) - container_1320304139196_0003_01_000001 Container Transitioned from NEW to ALLOCATED 2011-11-03 07:09:07,516 INFO [ResourceManager Event Processor] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=jenkins OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1320304139196_0003 CONTAINERID=container_1320304139196_0003_01_000001 2011-11-03 07:09:07,516 INFO [ResourceManager Event Processor] scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(103)) - Assigned container container_1320304139196_0003_01_000001 of capacity memory: 1024 on host asf005.sp2.ygridcore.net:44653, which currently has 1 containers, memory: 1024 used and memory: 3072 available 2011-11-03 07:09:07,516 INFO [ResourceManager Event Processor] fifo.FifoScheduler (FifoScheduler.java:nodeUpdate(576)) - Node after allocation asf005.sp2.ygridcore.net:44653 resource = memory: 3072 2011-11-03 07:09:07,516 INFO [AsyncDispatcher event handler] rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(195)) - Processing container_1320304139196_0003_01_000001 of type ACQUIRED 2011-11-03 07:09:07,517 INFO [AsyncDispatcher event handler] rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(207)) - container_1320304139196_0003_01_000001 Container Transitioned from ALLOCATED to ACQUIRED 2011-11-03 07:09:07,517 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(184)) - Exit code from task is : 143 2011-11-03 07:09:07,517 INFO [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(476)) - appattempt_1320304139196_0003_000001 State change from SUBMITTED to SCHEDULED 2011-11-03 07:09:07,517 INFO [ContainersLauncher #0] nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(154)) - 2011-11-03 07:09:07,517 INFO [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:handle(416)) - Processing event for application_1320304139196_0003 of type APP_ACCEPTED 2011-11-03 07:09:07,518 INFO [ContainersLauncher #0] container.Container (ContainerImpl.java:handle(818)) - Processing container_1320304139196_0002_01_000001 of type UPDATE_DIAGNOSTICS_MSG 2011-11-03 07:09:07,518 INFO [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:handle(428)) - application_1320304139196_0003 State change from SUBMITTED to ACCEPTED 2011-11-03 07:09:07,518 INFO [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(464)) - Processing event for appattempt_1320304139196_0003_000001 of type CONTAINER_ALLOCATED 2011-11-03 07:09:07,519 ERROR [AsyncDispatcher event handler] resourcemanager.ResourceManager (ResourceManager.java:handle(380)) - Error in handling event type CONTAINER_ALLOCATED for applicationAttempt application_1320304139196_0003 java.lang.IndexOutOfBoundsException: Index: 0, Size: 0 at java.util.ArrayList.RangeCheck(ArrayList.java:547) at java.util.ArrayList.get(ArrayList.java:322) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$AMContainerAllocatedTransition.transition(RMAppAttemptImpl.java:614) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$AMContainerAllocatedTransition.transition(RMAppAttemptImpl.java:603) at org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:357) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:298) at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:43) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:443) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:469) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:80) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:378) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:359) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:116) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:75) at java.lang. Thread .run( Thread .java:662) 2011-11-03 07:09:07,519 INFO [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(464)) - Processing event for appattempt_1320304139196_0003_000001 of type CONTAINER_ACQUIRED 2011-11-03 07:09:07,520 ERROR [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(471)) - Can't handle this event at current state org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: CONTAINER_ACQUIRED at SCHEDULED at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:301) at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:43) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:443) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:469) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:80) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:378) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:359) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:116) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:75) at java.lang. Thread .run( Thread .java:662) 2011-11-03 07:09:07,526 INFO [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(818)) - Processing container_1320304139196_0002_01_000001 of type KILL_CONTAINER 2011-11-03 07:09:07,526 WARN [AsyncDispatcher event handler] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:handle(495)) - Event EventType: KILL_CONTAINER sent to absent container container_1320304139196_0002_01_000002 2011-11-03 07:09:07,526 INFO [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:handle(376)) - Processing application_1320304139196_0002 of type FINISH_APPLICATION 2011-11-03 07:09:07,526 INFO [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:handle(387)) - Application application_1320304139196_0002 transitioned from RUNNING to FINISHING_CONTAINERS_WAIT 2011-11-03 07:09:07,527 INFO [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(818)) - Processing container_1320304139196_0002_01_000001 of type CONTAINER_KILLED_ON_REQUEST 2011-11-03 07:09:07,527 INFO [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(830)) - Container container_1320304139196_0002_01_000001 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2011-11-03 07:09:07,527 INFO [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(818)) - Processing container_1320304139196_0002_01_000001 of type KILL_CONTAINER 2011-11-03 07:09:07,527 INFO [AsyncDispatcher event handler] localizer.LocalizedResource (LocalizedResource.java:handle(184)) - Processing file:/home/jenkins/jenkins-slave/workspace/PreCommit-MAPREDUCE-Build/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/target/org.apache.hadoop.yarn.server.TestContainerManagerSecurity-localDir/testFile-application_1320304139196_0002 of type RELEASE 2011-11-03 07:09:07,528 INFO [DeletionService #3] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(265)) - Deleting absolute path : /home/jenkins/jenkins-slave/workspace/PreCommit-MAPREDUCE-Build/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-tests/target/org.apache.hadoop.yarn.server.TestContainerManagerSecurity/org.apache.hadoop.yarn.server.TestContainerManagerSecurity-localDir-nm-0/usercache/jenkins/appcache/application_1320304139196_0002/container_1320304139196_0002_01_000001 2011-11-03 07:09:07,528 INFO [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(818)) - Processing container_1320304139196_0002_01_000001 of type CONTAINER_RESOURCES_CLEANEDUP 2011-11-03 07:09:07,528 INFO [AsyncDispatcher event handler] nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=jenkins OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1320304139196_0002 CONTAINERID=container_1320304139196_0002_01_000001 2011-11-03 07:09:07,528 INFO [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(830)) - Container container_1320304139196_0002_01_000001 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2011-11-03 07:09:07,529 INFO [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:handle(376)) - Processing application_1320304139196_0002 of type APPLICATION_CONTAINER_FINISHED

        People

        • Assignee:
          Hitesh Shah
          Reporter:
          Vinod Kumar Vavilapalli
        • Votes:
          0 Vote for this issue
          Watchers:
          0 Start watching this issue

          Dates

          • Created:
            Updated:
            Resolved:

            Development