2014-04-18 15:38:14,957 WARN [main] util.NativeCodeLoader (NativeCodeLoader.java:(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2014-04-18 15:38:15,201 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(160)) - Created localDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:38:15,201 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(161)) - Created tmpDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2014-04-18 15:38:15,276 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2014-04-18 15:38:15,277 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2014-04-18 15:38:15,278 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService 2014-04-18 15:38:15,278 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2014-04-18 15:38:15,279 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2014-04-18 15:38:15,279 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2014-04-18 15:38:15,284 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(174)) - Initialized nodemanager for null: physical-memory=8192 virtual-memory=17204 virtual-cores=8 2014-04-18 15:38:15,285 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2014-04-18 15:38:15,286 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(199)) - per directory file limit = 8192 2014-04-18 15:38:15,316 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2014-04-18 15:38:15,325 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@5cad1e34 2014-04-18 15:38:15,325 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) - Using ResourceCalculatorProcessTree : null 2014-04-18 15:38:15,326 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: true 2014-04-18 15:38:15,328 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: true 2014-04-18 15:38:15,343 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(254)) - Registering with RM using finished containers :[] 2014-04-18 15:38:15,362 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id 123 2014-04-18 15:38:15,364 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :123 2014-04-18 15:38:15,364 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(304)) - Registered with ResourceManager as null with total resource of 2014-04-18 15:38:15,364 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(306)) - Notifying ContainerManager to unblock new container-requests 2014-04-18 15:38:15,389 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(369)) - Deleting absolute path : /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:38:15,428 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(160)) - Created localDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:38:15,429 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(161)) - Created tmpDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2014-04-18 15:38:15,447 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2014-04-18 15:38:15,448 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2014-04-18 15:38:15,448 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService 2014-04-18 15:38:15,448 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2014-04-18 15:38:15,448 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2014-04-18 15:38:15,448 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2014-04-18 15:38:15,449 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(174)) - Initialized nodemanager for null: physical-memory=8192 virtual-memory=17204 virtual-cores=8 2014-04-18 15:38:15,449 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2014-04-18 15:38:15,449 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(199)) - per directory file limit = 8192 2014-04-18 15:38:15,470 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2014-04-18 15:38:15,471 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@7e374aac 2014-04-18 15:38:15,472 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) - Using ResourceCalculatorProcessTree : null 2014-04-18 15:38:15,472 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: true 2014-04-18 15:38:15,472 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: true 2014-04-18 15:38:15,474 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(254)) - Registering with RM using finished containers :[] 2014-04-18 15:38:15,474 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id 123 2014-04-18 15:38:15,474 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :123 2014-04-18 15:38:15,474 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(304)) - Registered with ResourceManager as null with total resource of 2014-04-18 15:38:15,474 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(306)) - Notifying ContainerManager to unblock new container-requests 2014-04-18 15:38:15,508 INFO [main] ipc.CallQueueManager (CallQueueManager.java:(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue 2014-04-18 15:38:15,527 INFO [Socket Reader #1 for port 12345] ipc.Server (Server.java:run(596)) - Starting Socket Reader #1 for port 12345 2014-04-18 15:38:15,553 INFO [main] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server 2014-04-18 15:38:15,554 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(283)) - Blocking new container-requests as container manager rpc server is still starting. 2014-04-18 15:38:15,554 INFO [IPC Server Responder] ipc.Server (Server.java:run(818)) - IPC Server Responder: starting 2014-04-18 15:38:15,554 INFO [IPC Server listener on 12345] ipc.Server (Server.java:run(665)) - IPC Server listener on 12345: starting 2014-04-18 15:38:15,570 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : ip-172-31-7-130.ap-northeast-1.compute.internal:12345 2014-04-18 15:38:15,571 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(294)) - ContainerManager started at ip-172-31-7-130.ap-northeast-1.compute.internal/172.31.7.130:12345 2014-04-18 15:38:15,576 INFO [main] ipc.CallQueueManager (CallQueueManager.java:(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue 2014-04-18 15:38:15,577 INFO [Socket Reader #1 for port 8040] ipc.Server (Server.java:run(596)) - Starting Socket Reader #1 for port 8040 2014-04-18 15:38:15,579 INFO [main] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server 2014-04-18 15:38:15,579 INFO [IPC Server Responder] ipc.Server (Server.java:run(818)) - IPC Server Responder: starting 2014-04-18 15:38:15,580 INFO [IPC Server listener on 8040] ipc.Server (Server.java:run(665)) - IPC Server listener on 8040: starting 2014-04-18 15:38:15,581 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(266)) - Localizer started on port 8040 2014-04-18 15:38:15,648 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(572)) - Start request for container_1_0001_01_000000 by user nobody 2014-04-18 15:38:15,665 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(611)) - Creating a new application reference for app application_1_0001 2014-04-18 15:38:15,668 INFO [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:handle(450)) - Application application_1_0001 transitioned from NEW to INITING 2014-04-18 15:38:15,668 INFO [main] nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=nobody OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1_0001 CONTAINERID=container_1_0001_01_000000 2014-04-18 15:38:15,668 INFO [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:transition(296)) - Adding container_1_0001_01_000000 to application application_1_0001 2014-04-18 15:38:15,672 INFO [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:handle(450)) - Application application_1_0001 transitioned from INITING to RUNNING 2014-04-18 15:38:15,674 INFO [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(901)) - Container container_1_0001_01_000000 transitioned from NEW to LOCALIZING 2014-04-18 15:38:15,674 INFO [AsyncDispatcher event handler] containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1_0001 2014-04-18 15:38:15,709 INFO [AsyncDispatcher event handler] localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource file:/home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir/testscript.sh transitioned from INIT to DOWNLOADING 2014-04-18 15:38:15,709 INFO [AsyncDispatcher event handler] localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(596)) - Created localizer for container_1_0001_01_000000 2014-04-18 15:38:15,737 INFO [LocalizerRunner for container_1_0001_01_000000] localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1029)) - Writing credentials to the nmPrivate file /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/nmPrivate/container_1_0001_01_000000.tokens. Credentials list: 2014-04-18 15:38:15,742 INFO [LocalizerRunner for container_1_0001_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(469)) - Initializing user nobody 2014-04-18 15:38:15,758 INFO [LocalizerRunner for container_1_0001_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/nmPrivate/container_1_0001_01_000000.tokens to /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_1_0001/container_1_0001_01_000000.tokens 2014-04-18 15:38:15,758 INFO [LocalizerRunner for container_1_0001_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_1_0001 = file:/home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_1_0001 2014-04-18 15:38:15,950 INFO [IPC Server handler 1 on 8040] localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource file:/home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir/testscript.sh(->file:/home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_1_0001/filecache/10/testscript.sh) transitioned from DOWNLOADING to LOCALIZED 2014-04-18 15:38:15,951 INFO [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(901)) - Container container_1_0001_01_000000 transitioned from LOCALIZING to LOCALIZED 2014-04-18 15:38:15,976 INFO [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(901)) - Container container_1_0001_01_000000 transitioned from LOCALIZED to RUNNING 2014-04-18 15:38:16,000 INFO [ContainersLauncher #0] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [bash, /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_1_0001/container_1_0001_01_000000/default_container_executor.sh] 2014-04-18 15:38:16,674 INFO [main] containermanager.BaseContainerManagerTest (TestContainerLaunch.java:internalKillTest(692)) - Waiting for process start-file to be created 2014-04-18 15:38:16,676 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(718)) - Stopping container with container Id: container_1_0001_01_000000 2014-04-18 15:38:16,677 INFO [main] nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=nobody OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1_0001 CONTAINERID=container_1_0001_01_000000 2014-04-18 15:38:16,677 INFO [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(901)) - Container container_1_0001_01_000000 transitioned from RUNNING to KILLING 2014-04-18 15:38:16,677 INFO [AsyncDispatcher event handler] launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(358)) - Cleaning up container container_1_0001_01_000000 2014-04-18 15:38:16,683 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:16,687 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:16,953 INFO [LocalizerRunner for container_1_0001_01_000000] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(236)) - Psuedo delete: user - null, subDir - /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/nmPrivate/container_1_0001_01_000000.tokens, baseDirs - [Lorg.apache.hadoop.fs.Path;@3101e292 2014-04-18 15:38:17,691 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:17,691 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:17,691 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:18,582 INFO [Container Monitor] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(337)) - Starting resource-monitoring for container_1_0001_01_000000 2014-04-18 15:38:18,692 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:18,692 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:18,692 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:19,692 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:19,693 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:19,693 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:20,693 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:20,694 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:20,694 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:21,694 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:21,694 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:21,694 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:22,695 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:22,695 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:22,695 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:23,695 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:23,696 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:23,696 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:24,696 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:24,696 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:24,697 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:25,697 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:25,697 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:25,697 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:26,698 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:26,698 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:26,698 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:27,698 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:27,698 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:27,699 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:28,699 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:28,699 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:28,699 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:29,700 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:29,700 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:29,700 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:30,700 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:30,701 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:30,701 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:31,701 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:31,702 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:31,702 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:32,703 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:32,703 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:32,704 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:33,704 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:33,704 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:33,704 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:34,705 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:34,705 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:34,705 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:35,705 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:35,706 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:35,706 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:36,706 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:36,706 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:36,706 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:36,707 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(275)) - Container state is RUNNING 2014-04-18 15:38:36,707 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(330)) - Applications still running : [application_1_0001] 2014-04-18 15:38:36,709 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(338)) - Waiting for Applications to be Finished 2014-04-18 15:38:36,709 INFO [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:handle(450)) - Application application_1_0001 transitioned from RUNNING to FINISHING_CONTAINERS_WAIT 2014-04-18 15:38:40,709 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(355)) - Done waiting for Applications to be Finished. Still alive: [application_1_0001] 2014-04-18 15:38:40,709 INFO [main] ipc.Server (Server.java:stop(2484)) - Stopping server on 12345 2014-04-18 15:38:40,710 INFO [IPC Server listener on 12345] ipc.Server (Server.java:run(697)) - Stopping IPC Server listener on 12345 2014-04-18 15:38:40,710 INFO [IPC Server Responder] ipc.Server (Server.java:run(823)) - Stopping IPC Server Responder 2014-04-18 15:38:40,710 WARN [Container Monitor] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(463)) - org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is interrupted. Exiting. 2014-04-18 15:38:40,711 INFO [main] ipc.Server (Server.java:stop(2484)) - Stopping server on 8040 2014-04-18 15:38:40,711 INFO [IPC Server listener on 8040] ipc.Server (Server.java:run(697)) - Stopping IPC Server listener on 8040 2014-04-18 15:38:40,712 INFO [IPC Server Responder] ipc.Server (Server.java:run(823)) - Stopping IPC Server Responder 2014-04-18 15:38:40,712 INFO [Public Localizer] localizer.ResourceLocalizationService (ResourceLocalizationService.java:run(746)) - Public cache exiting 2014-04-18 15:38:40,721 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(369)) - Deleting absolute path : /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:38:40,750 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(160)) - Created localDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:38:40,750 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(161)) - Created tmpDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2014-04-18 15:38:40,761 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2014-04-18 15:38:40,761 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2014-04-18 15:38:40,761 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService 2014-04-18 15:38:40,762 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2014-04-18 15:38:40,762 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2014-04-18 15:38:40,762 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2014-04-18 15:38:40,762 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(174)) - Initialized nodemanager for null: physical-memory=8192 virtual-memory=17204 virtual-cores=8 2014-04-18 15:38:40,762 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2014-04-18 15:38:40,763 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(199)) - per directory file limit = 8192 2014-04-18 15:38:40,779 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2014-04-18 15:38:40,779 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@41fcab5d 2014-04-18 15:38:40,780 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) - Using ResourceCalculatorProcessTree : null 2014-04-18 15:38:40,780 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: true 2014-04-18 15:38:40,780 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: true 2014-04-18 15:38:40,782 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(254)) - Registering with RM using finished containers :[] 2014-04-18 15:38:40,782 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id 123 2014-04-18 15:38:40,782 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :123 2014-04-18 15:38:40,782 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(304)) - Registered with ResourceManager as null with total resource of 2014-04-18 15:38:40,782 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(306)) - Notifying ContainerManager to unblock new container-requests 2014-04-18 15:38:40,783 INFO [main] ipc.CallQueueManager (CallQueueManager.java:(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue 2014-04-18 15:38:40,784 INFO [Socket Reader #1 for port 12345] ipc.Server (Server.java:run(596)) - Starting Socket Reader #1 for port 12345 2014-04-18 15:38:40,786 INFO [main] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server 2014-04-18 15:38:40,787 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(283)) - Blocking new container-requests as container manager rpc server is still starting. 2014-04-18 15:38:40,787 INFO [IPC Server Responder] ipc.Server (Server.java:run(818)) - IPC Server Responder: starting 2014-04-18 15:38:40,787 INFO [IPC Server listener on 12345] ipc.Server (Server.java:run(665)) - IPC Server listener on 12345: starting 2014-04-18 15:38:40,791 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : ip-172-31-7-130.ap-northeast-1.compute.internal:12345 2014-04-18 15:38:40,791 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(294)) - ContainerManager started at ip-172-31-7-130.ap-northeast-1.compute.internal/172.31.7.130:12345 2014-04-18 15:38:40,792 INFO [main] ipc.CallQueueManager (CallQueueManager.java:(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue 2014-04-18 15:38:40,792 INFO [Socket Reader #1 for port 8040] ipc.Server (Server.java:run(596)) - Starting Socket Reader #1 for port 8040 2014-04-18 15:38:40,795 INFO [main] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server 2014-04-18 15:38:40,795 INFO [IPC Server Responder] ipc.Server (Server.java:run(818)) - IPC Server Responder: starting 2014-04-18 15:38:40,795 INFO [IPC Server listener on 8040] ipc.Server (Server.java:run(665)) - IPC Server listener on 8040: starting 2014-04-18 15:38:40,796 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(266)) - Localizer started on port 8040 2014-04-18 15:38:40,797 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(572)) - Start request for container_1_0001_01_000000 by user nobody 2014-04-18 15:38:40,798 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(611)) - Creating a new application reference for app application_1_0001 2014-04-18 15:38:40,798 INFO [main] nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=nobody OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1_0001 CONTAINERID=container_1_0001_01_000000 2014-04-18 15:38:40,798 INFO [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:handle(450)) - Application application_1_0001 transitioned from NEW to INITING 2014-04-18 15:38:40,798 INFO [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:transition(296)) - Adding container_1_0001_01_000000 to application application_1_0001 2014-04-18 15:38:40,799 INFO [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:handle(450)) - Application application_1_0001 transitioned from INITING to RUNNING 2014-04-18 15:38:40,799 INFO [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(901)) - Container container_1_0001_01_000000 transitioned from NEW to LOCALIZING 2014-04-18 15:38:40,799 INFO [AsyncDispatcher event handler] containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_1_0001 2014-04-18 15:38:40,800 INFO [AsyncDispatcher event handler] localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource file:/home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir/testscript.sh transitioned from INIT to DOWNLOADING 2014-04-18 15:38:40,800 INFO [AsyncDispatcher event handler] localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(596)) - Created localizer for container_1_0001_01_000000 2014-04-18 15:38:40,806 INFO [LocalizerRunner for container_1_0001_01_000000] localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1029)) - Writing credentials to the nmPrivate file /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/nmPrivate/container_1_0001_01_000000.tokens. Credentials list: 2014-04-18 15:38:40,809 INFO [LocalizerRunner for container_1_0001_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(469)) - Initializing user nobody 2014-04-18 15:38:40,824 INFO [LocalizerRunner for container_1_0001_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/nmPrivate/container_1_0001_01_000000.tokens to /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_1_0001/container_1_0001_01_000000.tokens 2014-04-18 15:38:40,825 INFO [LocalizerRunner for container_1_0001_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_1_0001 = file:/home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_1_0001 2014-04-18 15:38:40,867 INFO [IPC Server handler 1 on 8040] localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource file:/home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir/testscript.sh(->file:/home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_1_0001/filecache/10/testscript.sh) transitioned from DOWNLOADING to LOCALIZED 2014-04-18 15:38:40,867 INFO [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(901)) - Container container_1_0001_01_000000 transitioned from LOCALIZING to LOCALIZED 2014-04-18 15:38:40,888 INFO [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(901)) - Container container_1_0001_01_000000 transitioned from LOCALIZED to RUNNING 2014-04-18 15:38:40,915 INFO [ContainersLauncher #0] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [bash, /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_1_0001/container_1_0001_01_000000/default_container_executor.sh] 2014-04-18 15:38:41,798 INFO [main] containermanager.BaseContainerManagerTest (TestContainerLaunch.java:internalKillTest(692)) - Waiting for process start-file to be created 2014-04-18 15:38:41,799 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(718)) - Stopping container with container Id: container_1_0001_01_000000 2014-04-18 15:38:41,799 INFO [main] nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=nobody OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1_0001 CONTAINERID=container_1_0001_01_000000 2014-04-18 15:38:41,799 INFO [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(901)) - Container container_1_0001_01_000000 transitioned from RUNNING to KILLING 2014-04-18 15:38:41,799 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:41,799 INFO [AsyncDispatcher event handler] launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(358)) - Cleaning up container container_1_0001_01_000000 2014-04-18 15:38:41,799 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:41,870 INFO [LocalizerRunner for container_1_0001_01_000000] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(236)) - Psuedo delete: user - null, subDir - /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/nmPrivate/container_1_0001_01_000000.tokens, baseDirs - [Lorg.apache.hadoop.fs.Path;@2412cc06 2014-04-18 15:38:42,800 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:42,800 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:42,800 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:43,797 INFO [Container Monitor] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(337)) - Starting resource-monitoring for container_1_0001_01_000000 2014-04-18 15:38:43,801 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:43,801 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:43,801 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:44,801 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:44,802 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:44,802 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:45,802 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:45,802 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:45,803 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:46,803 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:46,803 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:46,804 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:47,804 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:47,804 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:47,804 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:48,805 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:48,805 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:48,805 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:49,805 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:49,806 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:49,806 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:50,806 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:50,806 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:50,807 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:51,807 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:51,807 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:51,808 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:52,808 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:52,808 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:52,809 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:53,809 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:53,809 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:53,810 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:54,810 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:54,810 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:54,811 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:55,811 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:55,811 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:55,812 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:56,812 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:56,812 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:56,812 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:57,813 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:57,813 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:57,813 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:58,814 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:58,814 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:58,814 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:38:59,814 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:38:59,815 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:38:59,815 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:39:00,815 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:39:00,816 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:39:00,816 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:39:01,816 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(271)) - Waiting for container to get into state COMPLETE. Current state is RUNNING 2014-04-18 15:39:01,816 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(771)) - Getting container-status for container_1_0001_01_000000 2014-04-18 15:39:01,817 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(785)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, State: RUNNING, Diagnostics: Container killed by the ApplicationMaster. , ExitStatus: -1000, ] 2014-04-18 15:39:01,817 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(275)) - Container state is RUNNING 2014-04-18 15:39:01,817 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(330)) - Applications still running : [application_1_0001] 2014-04-18 15:39:01,817 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(338)) - Waiting for Applications to be Finished 2014-04-18 15:39:01,817 INFO [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:handle(450)) - Application application_1_0001 transitioned from RUNNING to FINISHING_CONTAINERS_WAIT 2014-04-18 15:39:05,818 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(355)) - Done waiting for Applications to be Finished. Still alive: [application_1_0001] 2014-04-18 15:39:05,818 INFO [main] ipc.Server (Server.java:stop(2484)) - Stopping server on 12345 2014-04-18 15:39:05,820 INFO [IPC Server listener on 12345] ipc.Server (Server.java:run(697)) - Stopping IPC Server listener on 12345 2014-04-18 15:39:05,821 WARN [Container Monitor] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(463)) - org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is interrupted. Exiting. 2014-04-18 15:39:05,821 INFO [IPC Server Responder] ipc.Server (Server.java:run(823)) - Stopping IPC Server Responder 2014-04-18 15:39:05,822 INFO [main] ipc.Server (Server.java:stop(2484)) - Stopping server on 8040 2014-04-18 15:39:05,823 INFO [IPC Server listener on 8040] ipc.Server (Server.java:run(697)) - Stopping IPC Server listener on 8040 2014-04-18 15:39:05,824 INFO [IPC Server Responder] ipc.Server (Server.java:run(823)) - Stopping IPC Server Responder 2014-04-18 15:39:05,824 INFO [Public Localizer] localizer.ResourceLocalizationService (ResourceLocalizationService.java:run(746)) - Public cache exiting 2014-04-18 15:39:05,833 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(369)) - Deleting absolute path : /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:39:05,857 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(160)) - Created localDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:39:05,857 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(161)) - Created tmpDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2014-04-18 15:39:05,867 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2014-04-18 15:39:05,867 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2014-04-18 15:39:05,868 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService 2014-04-18 15:39:05,868 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2014-04-18 15:39:05,868 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2014-04-18 15:39:05,868 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2014-04-18 15:39:05,868 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(174)) - Initialized nodemanager for null: physical-memory=8192 virtual-memory=17204 virtual-cores=8 2014-04-18 15:39:05,869 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2014-04-18 15:39:05,869 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(199)) - per directory file limit = 8192 2014-04-18 15:39:05,882 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2014-04-18 15:39:05,883 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@59e1cd7f 2014-04-18 15:39:05,883 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) - Using ResourceCalculatorProcessTree : null 2014-04-18 15:39:05,883 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: true 2014-04-18 15:39:05,883 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: true 2014-04-18 15:39:05,885 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(254)) - Registering with RM using finished containers :[] 2014-04-18 15:39:05,885 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id 123 2014-04-18 15:39:05,885 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :123 2014-04-18 15:39:05,885 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(304)) - Registered with ResourceManager as null with total resource of 2014-04-18 15:39:05,885 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(306)) - Notifying ContainerManager to unblock new container-requests 2014-04-18 15:39:06,034 WARN [main] launcher.ContainerLaunch (ContainerLaunch.java:call(305)) - Failed to launch container. org.apache.hadoop.yarn.exceptions.YarnException: Unable to get local resources when Container container_1397835546010_0001_01_000001 is at null at org.apache.hadoop.yarn.ipc.RPCUtil.getRemoteException(RPCUtil.java:45) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:173) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.testCallFailureWithNullLocalizedResources(TestContainerLaunch.java:779) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:263) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:68) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:47) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:60) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:229) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:50) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:222) at org.junit.runners.ParentRunner.run(ParentRunner.java:300) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) 2014-04-18 15:39:06,043 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(369)) - Deleting absolute path : /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:39:06,058 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(160)) - Created localDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:39:06,058 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(161)) - Created tmpDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2014-04-18 15:39:06,066 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2014-04-18 15:39:06,066 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2014-04-18 15:39:06,066 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService 2014-04-18 15:39:06,066 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2014-04-18 15:39:06,066 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2014-04-18 15:39:06,066 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2014-04-18 15:39:06,066 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(174)) - Initialized nodemanager for null: physical-memory=8192 virtual-memory=17204 virtual-cores=8 2014-04-18 15:39:06,067 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2014-04-18 15:39:06,067 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(199)) - per directory file limit = 8192 2014-04-18 15:39:06,080 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2014-04-18 15:39:06,080 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@74d7313b 2014-04-18 15:39:06,080 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) - Using ResourceCalculatorProcessTree : null 2014-04-18 15:39:06,081 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: true 2014-04-18 15:39:06,081 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: true 2014-04-18 15:39:06,082 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(254)) - Registering with RM using finished containers :[] 2014-04-18 15:39:06,082 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id 123 2014-04-18 15:39:06,082 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :123 2014-04-18 15:39:06,082 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(304)) - Registered with ResourceManager as null with total resource of 2014-04-18 15:39:06,082 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(306)) - Notifying ContainerManager to unblock new container-requests 2014-04-18 15:39:06,096 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(369)) - Deleting absolute path : /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:39:06,111 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(160)) - Created localDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:39:06,111 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(161)) - Created tmpDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2014-04-18 15:39:06,118 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2014-04-18 15:39:06,118 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2014-04-18 15:39:06,118 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService 2014-04-18 15:39:06,118 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2014-04-18 15:39:06,119 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2014-04-18 15:39:06,119 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2014-04-18 15:39:06,119 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(174)) - Initialized nodemanager for null: physical-memory=8192 virtual-memory=17204 virtual-cores=8 2014-04-18 15:39:06,119 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2014-04-18 15:39:06,119 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(199)) - per directory file limit = 8192 2014-04-18 15:39:06,132 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2014-04-18 15:39:06,132 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@6972975c 2014-04-18 15:39:06,132 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) - Using ResourceCalculatorProcessTree : null 2014-04-18 15:39:06,132 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: true 2014-04-18 15:39:06,133 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: true 2014-04-18 15:39:06,134 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(254)) - Registering with RM using finished containers :[] 2014-04-18 15:39:06,134 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id 123 2014-04-18 15:39:06,134 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :123 2014-04-18 15:39:06,134 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(304)) - Registered with ResourceManager as null with total resource of 2014-04-18 15:39:06,134 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(306)) - Notifying ContainerManager to unblock new container-requests $HADOOP_HOME/share/hadoop/common/*:$HADOOP_HOME/share/hadoop/common/lib/*:$HADOOP_LOG_HOME/nm/container/logs 2014-04-18 15:39:06,141 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(369)) - Deleting absolute path : /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:39:06,155 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(160)) - Created localDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:39:06,155 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(161)) - Created tmpDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2014-04-18 15:39:06,162 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2014-04-18 15:39:06,163 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2014-04-18 15:39:06,163 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService 2014-04-18 15:39:06,163 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2014-04-18 15:39:06,163 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2014-04-18 15:39:06,163 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2014-04-18 15:39:06,163 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(174)) - Initialized nodemanager for null: physical-memory=8192 virtual-memory=17204 virtual-cores=8 2014-04-18 15:39:06,163 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2014-04-18 15:39:06,163 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(199)) - per directory file limit = 8192 2014-04-18 15:39:06,176 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2014-04-18 15:39:06,176 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@73e5ea01 2014-04-18 15:39:06,177 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) - Using ResourceCalculatorProcessTree : null 2014-04-18 15:39:06,177 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: true 2014-04-18 15:39:06,177 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: true 2014-04-18 15:39:06,178 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(254)) - Registering with RM using finished containers :[] 2014-04-18 15:39:06,178 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id 123 2014-04-18 15:39:06,178 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :123 2014-04-18 15:39:06,178 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(304)) - Registered with ResourceManager as null with total resource of 2014-04-18 15:39:06,178 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(306)) - Notifying ContainerManager to unblock new container-requests 2014-04-18 15:39:06,180 INFO [Thread-202] ipc.CallQueueManager (CallQueueManager.java:(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue 2014-04-18 15:39:06,180 INFO [Socket Reader #1 for port 12345] ipc.Server (Server.java:run(596)) - Starting Socket Reader #1 for port 12345 2014-04-18 15:39:06,183 INFO [Thread-202] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server 2014-04-18 15:39:06,183 INFO [Thread-202] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(283)) - Blocking new container-requests as container manager rpc server is still starting. 2014-04-18 15:39:06,183 INFO [IPC Server Responder] ipc.Server (Server.java:run(818)) - IPC Server Responder: starting 2014-04-18 15:39:06,183 INFO [IPC Server listener on 12345] ipc.Server (Server.java:run(665)) - IPC Server listener on 12345: starting 2014-04-18 15:39:06,187 INFO [Thread-202] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : ip-172-31-7-130.ap-northeast-1.compute.internal:12345 2014-04-18 15:39:06,187 INFO [Thread-202] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(294)) - ContainerManager started at ip-172-31-7-130.ap-northeast-1.compute.internal/172.31.7.130:12345 2014-04-18 15:39:06,188 INFO [Thread-202] ipc.CallQueueManager (CallQueueManager.java:(53)) - Using callQueue class java.util.concurrent.LinkedBlockingQueue 2014-04-18 15:39:06,188 INFO [Socket Reader #1 for port 8040] ipc.Server (Server.java:run(596)) - Starting Socket Reader #1 for port 8040 2014-04-18 15:39:06,190 INFO [Thread-202] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server 2014-04-18 15:39:06,191 INFO [IPC Server Responder] ipc.Server (Server.java:run(818)) - IPC Server Responder: starting 2014-04-18 15:39:06,191 INFO [IPC Server listener on 8040] ipc.Server (Server.java:run(665)) - IPC Server listener on 8040: starting 2014-04-18 15:39:06,192 INFO [Thread-202] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(266)) - Localizer started on port 8040 2014-04-18 15:39:06,195 INFO [Thread-202] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(572)) - Start request for container_0_0000_01_000000 by user nobody 2014-04-18 15:39:06,196 INFO [Thread-202] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(611)) - Creating a new application reference for app application_0_0000 2014-04-18 15:39:06,196 INFO [Thread-202] nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=nobody OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_0_0000 CONTAINERID=container_0_0000_01_000000 2014-04-18 15:39:06,196 INFO [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:handle(450)) - Application application_0_0000 transitioned from NEW to INITING 2014-04-18 15:39:06,196 INFO [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:transition(296)) - Adding container_0_0000_01_000000 to application application_0_0000 2014-04-18 15:39:06,196 INFO [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:handle(450)) - Application application_0_0000 transitioned from INITING to RUNNING 2014-04-18 15:39:06,197 INFO [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(901)) - Container container_0_0000_01_000000 transitioned from NEW to LOCALIZING 2014-04-18 15:39:06,197 INFO [AsyncDispatcher event handler] containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_INIT for appId application_0_0000 2014-04-18 15:39:06,197 INFO [AsyncDispatcher event handler] localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource file:/home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir/scriptFile.sh transitioned from INIT to DOWNLOADING 2014-04-18 15:39:06,197 INFO [AsyncDispatcher event handler] localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(596)) - Created localizer for container_0_0000_01_000000 2014-04-18 15:39:06,202 INFO [LocalizerRunner for container_0_0000_01_000000] localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1029)) - Writing credentials to the nmPrivate file /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/nmPrivate/container_0_0000_01_000000.tokens. Credentials list: 2014-04-18 15:39:06,205 INFO [LocalizerRunner for container_0_0000_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(469)) - Initializing user nobody 2014-04-18 15:39:06,218 INFO [LocalizerRunner for container_0_0000_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/nmPrivate/container_0_0000_01_000000.tokens to /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_0_0000/container_0_0000_01_000000.tokens 2014-04-18 15:39:06,218 INFO [LocalizerRunner for container_0_0000_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_0_0000 = file:/home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_0_0000 2014-04-18 15:39:06,253 INFO [IPC Server handler 1 on 8040] localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource file:/home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir/scriptFile.sh(->file:/home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_0_0000/filecache/10/scriptFile.sh) transitioned from DOWNLOADING to LOCALIZED 2014-04-18 15:39:06,253 INFO [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(901)) - Container container_0_0000_01_000000 transitioned from LOCALIZING to LOCALIZED 2014-04-18 15:39:06,270 INFO [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(901)) - Container container_0_0000_01_000000 transitioned from LOCALIZED to RUNNING 2014-04-18 15:39:06,294 INFO [ContainersLauncher #0] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [bash, /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_0_0000/container_0_0000_01_000000/default_container_executor.sh] 2014-04-18 15:39:07,196 INFO [Thread-202] containermanager.BaseContainerManagerTest (TestContainerLaunch.java:testContainerEnvVariables(488)) - Waiting for process start-file to be created 2014-04-18 15:39:07,199 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(330)) - Applications still running : [application_0_0000] 2014-04-18 15:39:07,199 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(338)) - Waiting for Applications to be Finished 2014-04-18 15:39:07,199 INFO [AsyncDispatcher event handler] application.Application (ApplicationImpl.java:handle(450)) - Application application_0_0000 transitioned from RUNNING to FINISHING_CONTAINERS_WAIT 2014-04-18 15:39:07,199 INFO [AsyncDispatcher event handler] container.Container (ContainerImpl.java:handle(901)) - Container container_0_0000_01_000000 transitioned from RUNNING to KILLING 2014-04-18 15:39:07,199 INFO [AsyncDispatcher event handler] launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(358)) - Cleaning up container container_0_0000_01_000000 2014-04-18 15:39:07,256 INFO [LocalizerRunner for container_0_0000_01_000000] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(236)) - Psuedo delete: user - null, subDir - /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/nmPrivate/container_0_0000_01_000000.tokens, baseDirs - [Lorg.apache.hadoop.fs.Path;@43c6c8fa 2014-04-18 15:39:09,194 INFO [Container Monitor] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(337)) - Starting resource-monitoring for container_0_0000_01_000000 2014-04-18 15:39:11,200 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(355)) - Done waiting for Applications to be Finished. Still alive: [application_0_0000] 2014-04-18 15:39:11,200 INFO [main] ipc.Server (Server.java:stop(2484)) - Stopping server on 12345 2014-04-18 15:39:11,202 INFO [IPC Server listener on 12345] ipc.Server (Server.java:run(697)) - Stopping IPC Server listener on 12345 2014-04-18 15:39:11,202 INFO [IPC Server Responder] ipc.Server (Server.java:run(823)) - Stopping IPC Server Responder 2014-04-18 15:39:11,203 WARN [Container Monitor] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(463)) - org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is interrupted. Exiting. 2014-04-18 15:39:11,204 INFO [main] ipc.Server (Server.java:stop(2484)) - Stopping server on 8040 2014-04-18 15:39:11,204 INFO [IPC Server listener on 8040] ipc.Server (Server.java:run(697)) - Stopping IPC Server listener on 8040 2014-04-18 15:39:11,204 INFO [IPC Server Responder] ipc.Server (Server.java:run(823)) - Stopping IPC Server Responder 2014-04-18 15:39:11,204 INFO [Public Localizer] localizer.ResourceLocalizationService (ResourceLocalizationService.java:run(746)) - Public cache exiting 2014-04-18 15:39:11,210 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(369)) - Deleting absolute path : /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:39:11,227 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(160)) - Created localDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:39:11,227 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(161)) - Created tmpDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2014-04-18 15:39:11,235 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2014-04-18 15:39:11,235 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2014-04-18 15:39:11,235 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService 2014-04-18 15:39:11,236 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2014-04-18 15:39:11,236 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2014-04-18 15:39:11,236 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2014-04-18 15:39:11,236 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(174)) - Initialized nodemanager for null: physical-memory=8192 virtual-memory=17204 virtual-cores=8 2014-04-18 15:39:11,236 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2014-04-18 15:39:11,236 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(199)) - per directory file limit = 8192 2014-04-18 15:39:11,249 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2014-04-18 15:39:11,249 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@5f0b08ea 2014-04-18 15:39:11,250 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) - Using ResourceCalculatorProcessTree : null 2014-04-18 15:39:11,250 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: true 2014-04-18 15:39:11,250 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: true 2014-04-18 15:39:11,251 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(254)) - Registering with RM using finished containers :[] 2014-04-18 15:39:11,251 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id 123 2014-04-18 15:39:11,251 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :123 2014-04-18 15:39:11,251 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(304)) - Registered with ResourceManager as null with total resource of 2014-04-18 15:39:11,251 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(306)) - Notifying ContainerManager to unblock new container-requests 2014-04-18 15:39:11,261 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(369)) - Deleting absolute path : /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:39:11,274 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(160)) - Created localDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:39:11,274 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(161)) - Created tmpDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2014-04-18 15:39:11,280 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2014-04-18 15:39:11,280 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2014-04-18 15:39:11,281 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService 2014-04-18 15:39:11,281 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2014-04-18 15:39:11,281 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2014-04-18 15:39:11,281 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2014-04-18 15:39:11,281 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(174)) - Initialized nodemanager for null: physical-memory=8192 virtual-memory=17204 virtual-cores=8 2014-04-18 15:39:11,281 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2014-04-18 15:39:11,281 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(199)) - per directory file limit = 8192 2014-04-18 15:39:11,294 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2014-04-18 15:39:11,294 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@64124f93 2014-04-18 15:39:11,295 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) - Using ResourceCalculatorProcessTree : null 2014-04-18 15:39:11,295 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: true 2014-04-18 15:39:11,295 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: true 2014-04-18 15:39:11,296 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(254)) - Registering with RM using finished containers :[] 2014-04-18 15:39:11,296 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id 123 2014-04-18 15:39:11,296 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :123 2014-04-18 15:39:11,296 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(304)) - Registered with ResourceManager as null with total resource of 2014-04-18 15:39:11,296 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(306)) - Notifying ContainerManager to unblock new container-requests 2014-04-18 15:39:11,303 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(369)) - Deleting absolute path : /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:39:11,320 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(160)) - Created localDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2014-04-18 15:39:11,320 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(161)) - Created tmpDir in /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2014-04-18 15:39:11,329 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2014-04-18 15:39:11,329 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2014-04-18 15:39:11,329 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService 2014-04-18 15:39:11,329 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2014-04-18 15:39:11,329 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2014-04-18 15:39:11,330 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2014-04-18 15:39:11,330 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(174)) - Initialized nodemanager for null: physical-memory=8192 virtual-memory=17204 virtual-cores=8 2014-04-18 15:39:11,330 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2014-04-18 15:39:11,330 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(199)) - per directory file limit = 8192 2014-04-18 15:39:11,343 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(197)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2014-04-18 15:39:11,343 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@50ed69d9 2014-04-18 15:39:11,343 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) - Using ResourceCalculatorProcessTree : null 2014-04-18 15:39:11,344 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: true 2014-04-18 15:39:11,344 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: true 2014-04-18 15:39:11,345 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(254)) - Registering with RM using finished containers :[] 2014-04-18 15:39:11,345 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id 123 2014-04-18 15:39:11,345 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :123 2014-04-18 15:39:11,345 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(304)) - Registered with ResourceManager as null with total resource of 2014-04-18 15:39:11,345 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(306)) - Notifying ContainerManager to unblock new container-requests 2014-04-18 15:39:11,358 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(369)) - Deleting absolute path : /home/ubuntu/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir