2017-12-14 11:45:58,382 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:45:58,384 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:45:58,387 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:45:58,387 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:45:58,484 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:45:58,492 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:58,498 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:58,546 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:45:58,548 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:45:58,549 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:45:58,549 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:45:58,549 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:45:58,550 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:45:58,550 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:45:58,566 INFO [main] conf.Configuration (Configuration.java:getConfResourceAsInputStream(2656)) - resource-types.xml not found 2017-12-14 11:45:58,567 INFO [main] resource.ResourceUtils (ResourceUtils.java:addResourcesFileToConf(392)) - Unable to find 'resource-types.xml'. 2017-12-14 11:45:58,574 INFO [main] conf.Configuration (Configuration.java:getConfResourceAsInputStream(2656)) - node-resources.xml not found 2017-12-14 11:45:58,574 INFO [main] resource.ResourceUtils (ResourceUtils.java:addResourcesFileToConf(392)) - Unable to find 'node-resources.xml'. 2017-12-14 11:45:58,576 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:45:58,584 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:45:58,595 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:45:58,596 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:45:58,596 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:45:58,596 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:45:58,621 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:58,627 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:45:58,627 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@66498326 2017-12-14 11:45:58,628 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:45:58,628 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:45:58,629 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:45:58,629 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:45:58,630 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:45:58,631 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:45:58,631 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:45:58,633 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:45:58,643 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:45:58,655 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:45:58,657 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:45:58,657 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of Received an expected exception: mkdir: cannot create directory ‘/invalidSrcDir’: Permission denied /bin/bash: unknownCommand: command not found 2017-12-14 11:45:58,694 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:45:58,708 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:45:58,709 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:45:58,709 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:45:58,709 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:45:58,714 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:45:58,719 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:58,723 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:58,732 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:45:58,733 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:45:58,733 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:45:58,733 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:45:58,733 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:45:58,733 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:45:58,733 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:45:58,734 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:45:58,735 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:45:58,735 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:45:58,735 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:45:58,735 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:45:58,735 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:45:58,748 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:58,749 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:45:58,749 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@72e5a8e 2017-12-14 11:45:58,750 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:45:58,750 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:45:58,750 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:45:58,750 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:45:58,751 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:45:58,751 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:45:58,751 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:45:58,751 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:45:58,751 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:45:58,751 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:45:58,752 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:45:58,752 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:45:58,763 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:45:58,776 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:45:58,777 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:45:58,777 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:45:58,777 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:45:58,783 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:45:58,788 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:58,792 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:58,818 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:45:58,818 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:45:58,818 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:45:58,818 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:45:58,818 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:45:58,819 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:45:58,819 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:45:58,819 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:45:58,820 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:45:58,820 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:45:58,820 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:45:58,820 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:45:58,820 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:45:58,834 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:58,834 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:45:58,835 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@6574a52c 2017-12-14 11:45:58,835 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:45:58,835 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:45:58,835 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:45:58,835 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:45:58,836 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:45:58,836 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:45:58,836 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:45:58,836 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:45:58,836 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:45:58,836 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:45:58,837 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:45:58,837 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:45:58,856 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:45:58,869 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:45:58,870 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:45:58,870 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:45:58,870 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:45:58,876 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:45:58,880 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:58,884 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:58,894 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:45:58,895 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:45:58,895 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:45:58,895 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:45:58,895 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:45:58,895 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:45:58,895 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:45:58,896 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:45:58,897 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:45:58,897 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:45:58,897 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:45:58,897 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:45:58,897 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:45:58,911 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:58,912 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:45:58,912 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@3b0fe47a 2017-12-14 11:45:58,912 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:45:58,912 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:45:58,912 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:45:58,913 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:45:58,913 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:45:58,913 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:45:58,913 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:45:58,913 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:45:58,914 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:45:58,914 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:45:58,914 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:45:58,914 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:45:58,930 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:45:58,941 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:45:58,942 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:45:58,942 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:45:58,942 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:45:58,947 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:45:58,951 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:58,955 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:58,966 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:45:58,967 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:45:58,967 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:45:58,967 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:45:58,967 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:45:58,967 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:45:58,967 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:45:58,968 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:45:58,968 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:45:58,969 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:45:58,969 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:45:58,969 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:45:58,969 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:45:58,983 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:58,984 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:45:58,984 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@353352b6 2017-12-14 11:45:58,984 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:45:58,984 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:45:58,985 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:45:58,985 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:45:58,985 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:45:58,985 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:45:58,985 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:45:58,985 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:45:58,986 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:45:58,986 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:45:58,986 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:45:58,986 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:45:59,018 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:45:59,030 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:45:59,030 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:45:59,030 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:45:59,031 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:45:59,035 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:45:59,039 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:59,043 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:59,053 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:45:59,053 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:45:59,053 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:45:59,053 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:45:59,053 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:45:59,053 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:45:59,054 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:45:59,054 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:45:59,055 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:45:59,055 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:45:59,055 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:45:59,055 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:45:59,055 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:45:59,069 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:59,069 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:45:59,070 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@533bda92 2017-12-14 11:45:59,070 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:45:59,070 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:45:59,070 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:45:59,070 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:45:59,071 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:45:59,071 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:45:59,071 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:45:59,071 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:45:59,071 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:45:59,071 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:45:59,072 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:45:59,072 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:45:59,097 INFO [Thread-46] ipc.CallQueueManager (CallQueueManager.java:(84)) - Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 2000 scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler 2017-12-14 11:45:59,108 INFO [Socket Reader #1 for port 49162] ipc.Server (Server.java:run(1067)) - Starting Socket Reader #1 for port 49162 2017-12-14 11:45:59,127 INFO [Thread-46] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(173)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server 2017-12-14 11:45:59,127 INFO [IPC Server Responder] ipc.Server (Server.java:run(1307)) - IPC Server Responder: starting 2017-12-14 11:45:59,128 INFO [IPC Server listener on 49162] ipc.Server (Server.java:run(1146)) - IPC Server listener on 49162: starting 2017-12-14 11:45:59,134 INFO [Thread-46] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(260)) - Updating node address : localhost:49162 2017-12-14 11:45:59,137 INFO [Thread-46] ipc.CallQueueManager (CallQueueManager.java:(84)) - Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 500 scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler 2017-12-14 11:45:59,137 INFO [Socket Reader #1 for port 8040] ipc.Server (Server.java:run(1067)) - Starting Socket Reader #1 for port 8040 2017-12-14 11:45:59,139 INFO [Thread-46] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(173)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server 2017-12-14 11:45:59,139 INFO [IPC Server Responder] ipc.Server (Server.java:run(1307)) - IPC Server Responder: starting 2017-12-14 11:45:59,139 INFO [IPC Server listener on 8040] ipc.Server (Server.java:run(1146)) - IPC Server listener on 8040: starting 2017-12-14 11:45:59,141 INFO [Thread-46] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(385)) - Localizer started on port 8040 2017-12-14 11:45:59,151 INFO [Thread-46] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(655)) - ContainerManager started at localhost/127.0.0.1:49162 2017-12-14 11:45:59,152 INFO [Thread-46] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(656)) - ContainerManager bound to 0.0.0.0/0.0.0.0:49162 2017-12-14 11:45:59,275 INFO [Thread-46] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(1059)) - Start request for container_1_0001_01_000000 by user nobody 2017-12-14 11:45:59,305 INFO [Thread-46] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(1127)) - Creating a new application reference for app application_1_0001 2017-12-14 11:45:59,351 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:handle(632)) - Application application_1_0001 transitioned from NEW to INITING 2017-12-14 11:45:59,352 INFO [Thread-46] nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(94)) - USER=nobody OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1_0001 CONTAINERID=container_1_0001_01_000000 2017-12-14 11:45:59,352 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:transition(446)) - Adding container_1_0001_01_000000 to application application_1_0001 2017-12-14 11:45:59,354 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:handle(632)) - Application application_1_0001 transitioned from INITING to RUNNING 2017-12-14 11:45:59,355 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_1_0001_01_000000 transitioned from NEW to LOCALIZING 2017-12-14 11:45:59,356 INFO [NM ContainerManager dispatcher] containermanager.AuxServices (AuxServices.java:handle(220)) - Got event CONTAINER_INIT for appId application_1_0001 2017-12-14 11:45:59,361 INFO [NM ContainerManager dispatcher] localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(791)) - Created localizer for container_1_0001_01_000000 2017-12-14 11:45:59,386 INFO [LocalizerRunner for container_1_0001_01_000000] localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1322)) - Writing credentials to the nmPrivate file /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/nmPrivate/container_1_0001_01_000000.tokens 2017-12-14 11:45:59,388 INFO [LocalizerRunner for container_1_0001_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(827)) - Initializing user nobody 2017-12-14 11:45:59,400 INFO [LocalizerRunner for container_1_0001_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(167)) - Copying from /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/nmPrivate/container_1_0001_01_000000.tokens to /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_1_0001/container_1_0001_01_000000.tokens 2017-12-14 11:45:59,400 INFO [LocalizerRunner for container_1_0001_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(175)) - Localizer CWD set to /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_1_0001 = file:/home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_1_0001 2017-12-14 11:45:59,405 INFO [LocalizerRunner for container_1_0001_01_000000] localizer.ContainerLocalizer (ContainerLocalizer.java:(140)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:45:59,492 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_1_0001_01_000000 transitioned from LOCALIZING to SCHEDULED 2017-12-14 11:45:59,493 INFO [NM ContainerManager dispatcher] scheduler.ContainerScheduler (ContainerScheduler.java:startContainer(491)) - Starting container [container_1_0001_01_000000] 2017-12-14 11:45:59,519 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_1_0001_01_000000 transitioned from SCHEDULED to RUNNING 2017-12-14 11:45:59,519 INFO [NM ContainerManager dispatcher] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:onStartMonitoringContainer(907)) - Starting resource-monitoring for container_1_0001_01_000000 2017-12-14 11:45:59,526 INFO [ContainersLauncher #0] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(365)) - launchContainer: [bash, /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_1_0001/container_1_0001_01_000000/default_container_executor.sh] 2017-12-14 11:46:00,358 INFO [Thread-46] containermanager.BaseContainerManagerTest (TestContainerLaunch.java:internalKillTest(1113)) - Waiting for process start-file to be created 2017-12-14 11:46:00,367 INFO [Thread-46] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(1365)) - Stopping container with container Id: container_1_0001_01_000000 2017-12-14 11:46:00,368 INFO [Thread-46] nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(94)) - USER=nobody OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1_0001 CONTAINERID=container_1_0001_01_000000 2017-12-14 11:46:00,369 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_1_0001_01_000000 transitioned from RUNNING to KILLING 2017-12-14 11:46:00,369 INFO [NM ContainerManager dispatcher] launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(670)) - Cleaning up container container_1_0001_01_000000 2017-12-14 11:46:00,378 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(306)) - Exit code from container container_1_0001_01_000000 is : 137 2017-12-14 11:46:00,381 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_1_0001_01_000000 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-12-14 11:46:00,381 INFO [NM ContainerManager dispatcher] localizer.ResourceLocalizationService (ResourceLocalizationService.java:cleanupPrivLocalizers(812)) - Interrupting localizer for container_1_0001_01_000000 2017-12-14 11:46:00,386 INFO [NM ContainerManager dispatcher] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:00,386 INFO [LocalizerRunner for container_1_0001_01_000000] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:00,386 INFO [NM ContainerManager dispatcher] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:00,386 INFO [NM ContainerManager dispatcher] nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(94)) - USER=nobody OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1_0001 CONTAINERID=container_1_0001_01_000000 2017-12-14 11:46:00,393 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_1_0001_01_000000 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-12-14 11:46:00,393 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:transition(489)) - Removing container_1_0001_01_000000 from application application_1_0001 2017-12-14 11:46:00,393 INFO [NM ContainerManager dispatcher] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:onStopMonitoringContainer(898)) - Stopping resource-monitoring for container_1_0001_01_000000 2017-12-14 11:46:00,393 INFO [NM ContainerManager dispatcher] containermanager.AuxServices (AuxServices.java:handle(220)) - Got event CONTAINER_STOP for appId application_1_0001 2017-12-14 11:46:01,374 INFO [Thread-46] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1419)) - Getting container-status for container_1_0001_01_000000 2017-12-14 11:46:01,375 INFO [Thread-46] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1433)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, ExecutionType: GUARANTEED, State: COMPLETE, Capability: , Diagnostics: [2017-12-14 11:46:00.368]Container killed by the ApplicationMaster.[2017-12-14 11:46:00.369] [2017-12-14 11:46:00.379]Container killed on request. Exit code is 137[2017-12-14 11:46:00.379] [2017-12-14 11:46:00.381]Container exited with a non-zero exit code 137. [2017-12-14 11:46:00.381] , ExitStatus: -105, IP: null, Host: null, ContainerSubState: DONE] 2017-12-14 11:46:01,381 INFO [Thread-46] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(319)) - Waiting for container to get into one of states [COMPLETE]. Current state is COMPLETE 2017-12-14 11:46:01,381 INFO [Thread-46] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(324)) - Container state is COMPLETE 2017-12-14 11:46:01,381 INFO [Thread-46] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1419)) - Getting container-status for container_1_0001_01_000000 2017-12-14 11:46:01,382 INFO [Thread-46] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1433)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, ExecutionType: GUARANTEED, State: COMPLETE, Capability: , Diagnostics: [2017-12-14 11:46:00.368]Container killed by the ApplicationMaster.[2017-12-14 11:46:00.369] [2017-12-14 11:46:00.379]Container killed on request. Exit code is 137[2017-12-14 11:46:00.379] [2017-12-14 11:46:00.381]Container exited with a non-zero exit code 137. [2017-12-14 11:46:00.381] , ExitStatus: -105, IP: null, Host: null, ContainerSubState: DONE] 2017-12-14 11:46:01,385 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(701)) - Applications still running : [application_1_0001] 2017-12-14 11:46:01,386 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(717)) - Waiting for Applications to be Finished 2017-12-14 11:46:01,386 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:handle(632)) - Application application_1_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP 2017-12-14 11:46:01,387 INFO [NM ContainerManager dispatcher] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:01,387 INFO [NM ContainerManager dispatcher] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:01,387 INFO [NM ContainerManager dispatcher] containermanager.AuxServices (AuxServices.java:handle(220)) - Got event APPLICATION_STOP for appId application_1_0001 2017-12-14 11:46:01,388 ERROR [NM ContainerManager dispatcher] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:appFinished(203)) - No application Attempt for application : application_1_0001 started on this NM. 2017-12-14 11:46:01,388 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:handle(632)) - Application application_1_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED 2017-12-14 11:46:01,388 INFO [NM ContainerManager dispatcher] loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(169)) - Scheduling Log Deletion for application: application_1_0001, with delay of 1 seconds 2017-12-14 11:46:02,392 INFO [LogDeleter #0] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:03,392 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(732)) - All applications in FINISHED state 2017-12-14 11:46:03,393 INFO [main] ipc.Server (Server.java:stop(3074)) - Stopping server on 49162 2017-12-14 11:46:03,395 INFO [IPC Server Responder] ipc.Server (Server.java:run(1312)) - Stopping IPC Server Responder 2017-12-14 11:46:03,395 INFO [IPC Server listener on 49162] ipc.Server (Server.java:run(1178)) - Stopping IPC Server listener on 49162 2017-12-14 11:46:03,396 WARN [Container Monitor] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(494)) - org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is interrupted. Exiting. 2017-12-14 11:46:03,397 INFO [main] ipc.Server (Server.java:stop(3074)) - Stopping server on 8040 2017-12-14 11:46:03,398 INFO [Public Localizer] localizer.ResourceLocalizationService (ResourceLocalizationService.java:run(973)) - Public cache exiting 2017-12-14 11:46:03,398 INFO [IPC Server listener on 8040] ipc.Server (Server.java:run(1178)) - Stopping IPC Server listener on 8040 2017-12-14 11:46:03,398 INFO [IPC Server Responder] ipc.Server (Server.java:run(1312)) - Stopping IPC Server Responder 2017-12-14 11:46:03,403 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:03,414 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:03,414 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:03,414 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:03,414 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:03,419 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:03,423 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,427 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,441 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:03,442 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:03,442 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:03,442 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:03,442 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:03,442 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:03,442 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:03,442 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:03,443 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:03,443 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:03,443 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:03,443 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:03,443 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:03,455 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,456 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:03,456 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@15a34df2 2017-12-14 11:46:03,456 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:03,456 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:03,456 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:03,456 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:03,457 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:03,457 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:03,457 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:03,457 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:03,457 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:03,457 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:03,457 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:03,457 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:03,474 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:03,484 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:03,485 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:03,485 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:03,485 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:03,489 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:03,493 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,497 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,507 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:03,508 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:03,508 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:03,508 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:03,508 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:03,508 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:03,508 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:03,509 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:03,509 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:03,509 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:03,509 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:03,509 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:03,510 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:03,521 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,521 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:03,522 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@3932c79a 2017-12-14 11:46:03,522 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:03,522 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:03,522 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:03,522 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:03,523 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:03,523 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:03,523 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:03,523 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:03,523 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:03,523 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:03,524 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:03,524 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:03,529 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:03,541 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:03,541 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:03,541 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:03,541 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:03,546 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:03,551 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,555 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,564 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:03,564 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:03,564 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:03,564 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:03,564 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:03,565 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:03,565 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:03,565 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:03,566 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:03,566 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:03,566 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:03,566 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:03,566 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:03,578 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,578 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:03,579 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@1b66c0fb 2017-12-14 11:46:03,579 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:03,579 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:03,579 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:03,579 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:03,580 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:03,580 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:03,580 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:03,580 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:03,580 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:03,581 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:03,581 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:03,581 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:03,586 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:03,596 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:03,596 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:03,596 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:03,597 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:03,600 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:03,604 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,608 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,617 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:03,617 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:03,617 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:03,617 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:03,618 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:03,618 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:03,618 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:03,618 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:03,619 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:03,619 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:03,619 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:03,619 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:03,619 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:03,632 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,632 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:03,633 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@3bcd05cb 2017-12-14 11:46:03,633 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:03,633 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:03,633 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:03,633 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:03,633 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:03,634 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:03,634 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:03,634 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:03,634 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:03,634 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:03,634 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:03,634 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of Received an expected exception: 2017-12-14 11:46:03,644 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:03,654 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:03,654 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:03,654 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:03,655 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:03,659 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:03,663 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,668 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,678 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:03,678 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:03,678 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:03,678 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:03,678 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:03,679 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:03,679 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:03,679 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:03,680 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:03,680 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:03,680 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:03,680 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:03,680 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:03,692 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,693 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:03,693 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@54e041a4 2017-12-14 11:46:03,693 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:03,693 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:03,693 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:03,693 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:03,694 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:03,694 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:03,694 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:03,694 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:03,694 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:03,694 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:03,695 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:03,695 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:03,749 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(365)) - launchContainer: [bash, /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/test/appcache/application_1513269963704_0001/container_1513269963704_0001_01_000001/default_container_executor.sh] 2017-12-14 11:46:03,761 WARN [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(306)) - Exit code from container container_1513269963704_0001_01_000001 is : 127 2017-12-14 11:46:03,762 WARN [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(312)) - Exception from container-launch with container ID: container_1513269963704_0001_01_000001 and exit code: 127 ExitCodeException exitCode=127: at org.apache.hadoop.util.Shell.runCommand(Shell.java:994) at org.apache.hadoop.util.Shell.run(Shell.java:887) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1212) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:295) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor$$EnhancerByMockitoWithCGLIB$$3ff969cf.CGLIB$launchContainer$1() at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor$$EnhancerByMockitoWithCGLIB$$3ff969cf$$FastClassByMockitoWithCGLIB$$72cfd232.invoke() at org.mockito.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:216) at org.mockito.internal.creation.AbstractMockitoMethodProxy.invokeSuper(AbstractMockitoMethodProxy.java:10) at org.mockito.internal.invocation.realmethod.CGLIBProxyRealMethod.invoke(CGLIBProxyRealMethod.java:22) at org.mockito.internal.invocation.realmethod.FilteredCGLIBProxyRealMethod.invoke(FilteredCGLIBProxyRealMethod.java:27) at org.mockito.internal.invocation.Invocation.callRealMethod(Invocation.java:211) at org.mockito.internal.stubbing.answers.CallsRealMethods.answer(CallsRealMethods.java:36) at org.mockito.internal.MockHandler.handle(MockHandler.java:99) at org.mockito.internal.creation.MethodInterceptorFilter.intercept(MethodInterceptorFilter.java:47) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor$$EnhancerByMockitoWithCGLIB$$3ff969cf.launchContainer() at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:467) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:287) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.verifyTailErrorLogOnContainerExit(TestContainerLaunch.java:716) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.testErrorLogOnContainerExitWithMultipleFiles(TestContainerLaunch.java:648) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) 2017-12-14 11:46:03,766 INFO [main] nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(483)) - Exception from container-launch. 2017-12-14 11:46:03,766 INFO [main] nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(483)) - Container id: container_1513269963704_0001_01_000001 2017-12-14 11:46:03,766 INFO [main] nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(483)) - Exit code: 127 2017-12-14 11:46:03,767 WARN [main] launcher.ContainerLaunch (ContainerLaunch.java:handleContainerExitWithFailure(534)) - Container launch failed : Container exited with a non-zero exit code 127. 2017-12-14 11:46:03,792 INFO [main] containermanager.BaseContainerManagerTest (TestContainerLaunch.java:handle(740)) - Diagnostic Info : Container exited with a non-zero exit code 127. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Error files: stderr.log, stdout. Last 4096 bytes of stderr.log : /bin/bash: /no/jvm/here/bin/java: No such file or directory 2017-12-14 11:46:03,797 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:03,808 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:03,808 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:03,808 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:03,808 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:03,812 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:03,816 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,820 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,830 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:03,830 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:03,830 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:03,830 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:03,830 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:03,830 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:03,830 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:03,831 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:03,832 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:03,832 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:03,832 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:03,832 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:03,832 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:03,843 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,844 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:03,844 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@4bf48f6 2017-12-14 11:46:03,844 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:03,844 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:03,844 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:03,845 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:03,845 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:03,845 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:03,845 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:03,845 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:03,845 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:03,845 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:03,846 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:03,846 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:03,847 INFO [Thread-135] ipc.CallQueueManager (CallQueueManager.java:(84)) - Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 2000 scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler 2017-12-14 11:46:03,847 INFO [Socket Reader #1 for port 49162] ipc.Server (Server.java:run(1067)) - Starting Socket Reader #1 for port 49162 2017-12-14 11:46:03,848 INFO [Thread-135] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(173)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server 2017-12-14 11:46:03,849 INFO [IPC Server Responder] ipc.Server (Server.java:run(1307)) - IPC Server Responder: starting 2017-12-14 11:46:03,849 INFO [IPC Server listener on 49162] ipc.Server (Server.java:run(1146)) - IPC Server listener on 49162: starting 2017-12-14 11:46:03,861 INFO [Thread-135] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(260)) - Updating node address : localhost:49162 2017-12-14 11:46:03,862 INFO [Thread-135] ipc.CallQueueManager (CallQueueManager.java:(84)) - Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 500 scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler 2017-12-14 11:46:03,863 INFO [Socket Reader #1 for port 8040] ipc.Server (Server.java:run(1067)) - Starting Socket Reader #1 for port 8040 2017-12-14 11:46:03,864 INFO [Thread-135] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(173)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server 2017-12-14 11:46:03,864 INFO [IPC Server Responder] ipc.Server (Server.java:run(1307)) - IPC Server Responder: starting 2017-12-14 11:46:03,865 INFO [IPC Server listener on 8040] ipc.Server (Server.java:run(1146)) - IPC Server listener on 8040: starting 2017-12-14 11:46:03,866 INFO [Thread-135] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(385)) - Localizer started on port 8040 2017-12-14 11:46:03,874 INFO [Thread-135] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(655)) - ContainerManager started at localhost/127.0.0.1:49162 2017-12-14 11:46:03,874 INFO [Thread-135] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(656)) - ContainerManager bound to 0.0.0.0/0.0.0.0:49162 2017-12-14 11:46:03,877 INFO [Thread-135] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(1059)) - Start request for container_0_0000_01_000000 by user nobody 2017-12-14 11:46:03,878 INFO [Thread-135] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(1127)) - Creating a new application reference for app application_0_0000 2017-12-14 11:46:03,878 INFO [Thread-135] nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(94)) - USER=nobody OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_0_0000 CONTAINERID=container_0_0000_01_000000 2017-12-14 11:46:03,880 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:handle(632)) - Application application_0_0000 transitioned from NEW to INITING 2017-12-14 11:46:03,880 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:transition(446)) - Adding container_0_0000_01_000000 to application application_0_0000 2017-12-14 11:46:03,880 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:handle(632)) - Application application_0_0000 transitioned from INITING to RUNNING 2017-12-14 11:46:03,880 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_0_0000_01_000000 transitioned from NEW to LOCALIZING 2017-12-14 11:46:03,880 INFO [NM ContainerManager dispatcher] containermanager.AuxServices (AuxServices.java:handle(220)) - Got event CONTAINER_INIT for appId application_0_0000 2017-12-14 11:46:03,880 INFO [NM ContainerManager dispatcher] localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(791)) - Created localizer for container_0_0000_01_000000 2017-12-14 11:46:03,884 INFO [LocalizerRunner for container_0_0000_01_000000] localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1322)) - Writing credentials to the nmPrivate file /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/nmPrivate/container_0_0000_01_000000.tokens 2017-12-14 11:46:03,886 INFO [LocalizerRunner for container_0_0000_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(827)) - Initializing user nobody 2017-12-14 11:46:03,889 INFO [LocalizerRunner for container_0_0000_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(167)) - Copying from /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/nmPrivate/container_0_0000_01_000000.tokens to /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_0_0000/container_0_0000_01_000000.tokens 2017-12-14 11:46:03,890 INFO [LocalizerRunner for container_0_0000_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(175)) - Localizer CWD set to /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_0_0000 = file:/home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_0_0000 2017-12-14 11:46:03,894 INFO [LocalizerRunner for container_0_0000_01_000000] localizer.ContainerLocalizer (ContainerLocalizer.java:(140)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:03,911 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_0_0000_01_000000 transitioned from LOCALIZING to SCHEDULED 2017-12-14 11:46:03,911 INFO [NM ContainerManager dispatcher] scheduler.ContainerScheduler (ContainerScheduler.java:startContainer(491)) - Starting container [container_0_0000_01_000000] 2017-12-14 11:46:03,930 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_0_0000_01_000000 transitioned from SCHEDULED to RUNNING 2017-12-14 11:46:03,931 INFO [NM ContainerManager dispatcher] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:onStartMonitoringContainer(907)) - Starting resource-monitoring for container_0_0000_01_000000 2017-12-14 11:46:03,935 INFO [ContainersLauncher #0] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(365)) - launchContainer: [bash, /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_0_0000/container_0_0000_01_000000/default_container_executor.sh] 2017-12-14 11:46:03,961 INFO [Thread-135] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(1365)) - Stopping container with container Id: container_0_0000_01_000000 2017-12-14 11:46:03,961 INFO [Thread-135] nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(94)) - USER=nobody OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_0_0000 CONTAINERID=container_0_0000_01_000000 2017-12-14 11:46:03,961 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_0_0000_01_000000 transitioned from RUNNING to KILLING 2017-12-14 11:46:03,961 INFO [NM ContainerManager dispatcher] launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(670)) - Cleaning up container container_0_0000_01_000000 2017-12-14 11:46:03,968 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(306)) - Exit code from container container_0_0000_01_000000 is : 143 2017-12-14 11:46:03,971 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_0_0000_01_000000 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-12-14 11:46:03,971 INFO [NM ContainerManager dispatcher] localizer.ResourceLocalizationService (ResourceLocalizationService.java:cleanupPrivLocalizers(812)) - Interrupting localizer for container_0_0000_01_000000 2017-12-14 11:46:03,971 INFO [NM ContainerManager dispatcher] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:03,972 INFO [LocalizerRunner for container_0_0000_01_000000] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:03,972 INFO [NM ContainerManager dispatcher] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:03,972 INFO [NM ContainerManager dispatcher] nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(94)) - USER=nobody OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_0_0000 CONTAINERID=container_0_0000_01_000000 2017-12-14 11:46:03,972 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_0_0000_01_000000 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-12-14 11:46:03,972 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:transition(489)) - Removing container_0_0000_01_000000 from application application_0_0000 2017-12-14 11:46:03,972 INFO [NM ContainerManager dispatcher] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:onStopMonitoringContainer(898)) - Stopping resource-monitoring for container_0_0000_01_000000 2017-12-14 11:46:03,972 INFO [NM ContainerManager dispatcher] containermanager.AuxServices (AuxServices.java:handle(220)) - Got event CONTAINER_STOP for appId application_0_0000 2017-12-14 11:46:04,963 INFO [Thread-135] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1419)) - Getting container-status for container_0_0000_01_000000 2017-12-14 11:46:04,964 INFO [Thread-135] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1433)) - Returning ContainerStatus: [ContainerId: container_0_0000_01_000000, ExecutionType: GUARANTEED, State: COMPLETE, Capability: , Diagnostics: [2017-12-14 11:46:03.961]Container killed by the ApplicationMaster.[2017-12-14 11:46:03.961] [2017-12-14 11:46:03.968]Container killed on request. Exit code is 143[2017-12-14 11:46:03.968] [2017-12-14 11:46:03.971]Container exited with a non-zero exit code 143. [2017-12-14 11:46:03.971] , ExitStatus: -105, IP: null, Host: null, ContainerSubState: DONE] 2017-12-14 11:46:04,964 INFO [Thread-135] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(319)) - Waiting for container to get into one of states [COMPLETE]. Current state is COMPLETE 2017-12-14 11:46:04,964 INFO [Thread-135] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(324)) - Container state is COMPLETE 2017-12-14 11:46:04,965 INFO [Thread-135] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1419)) - Getting container-status for container_0_0000_01_000000 2017-12-14 11:46:04,965 INFO [Thread-135] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1433)) - Returning ContainerStatus: [ContainerId: container_0_0000_01_000000, ExecutionType: GUARANTEED, State: COMPLETE, Capability: , Diagnostics: [2017-12-14 11:46:03.961]Container killed by the ApplicationMaster.[2017-12-14 11:46:03.961] [2017-12-14 11:46:03.968]Container killed on request. Exit code is 143[2017-12-14 11:46:03.968] [2017-12-14 11:46:03.971]Container exited with a non-zero exit code 143. [2017-12-14 11:46:03.971] , ExitStatus: -105, IP: null, Host: null, ContainerSubState: DONE] 2017-12-14 11:46:04,969 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(701)) - Applications still running : [application_0_0000] 2017-12-14 11:46:04,969 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(717)) - Waiting for Applications to be Finished 2017-12-14 11:46:04,969 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:handle(632)) - Application application_0_0000 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP 2017-12-14 11:46:04,970 INFO [NM ContainerManager dispatcher] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:04,970 INFO [NM ContainerManager dispatcher] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:04,970 INFO [NM ContainerManager dispatcher] containermanager.AuxServices (AuxServices.java:handle(220)) - Got event APPLICATION_STOP for appId application_0_0000 2017-12-14 11:46:04,970 ERROR [NM ContainerManager dispatcher] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:appFinished(203)) - No application Attempt for application : application_0_0000 started on this NM. 2017-12-14 11:46:04,970 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:handle(632)) - Application application_0_0000 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED 2017-12-14 11:46:04,970 INFO [NM ContainerManager dispatcher] loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(169)) - Scheduling Log Deletion for application: application_0_0000, with delay of 1 seconds 2017-12-14 11:46:05,971 INFO [LogDeleter #0] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:06,971 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(732)) - All applications in FINISHED state 2017-12-14 11:46:06,971 INFO [main] ipc.Server (Server.java:stop(3074)) - Stopping server on 49162 2017-12-14 11:46:06,972 INFO [IPC Server Responder] ipc.Server (Server.java:run(1312)) - Stopping IPC Server Responder 2017-12-14 11:46:06,972 INFO [IPC Server listener on 49162] ipc.Server (Server.java:run(1178)) - Stopping IPC Server listener on 49162 2017-12-14 11:46:06,973 WARN [Container Monitor] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(494)) - org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is interrupted. Exiting. 2017-12-14 11:46:06,973 INFO [main] ipc.Server (Server.java:stop(3074)) - Stopping server on 8040 2017-12-14 11:46:06,973 INFO [IPC Server Responder] ipc.Server (Server.java:run(1312)) - Stopping IPC Server Responder 2017-12-14 11:46:06,973 INFO [IPC Server listener on 8040] ipc.Server (Server.java:run(1178)) - Stopping IPC Server listener on 8040 2017-12-14 11:46:06,974 INFO [Public Localizer] localizer.ResourceLocalizationService (ResourceLocalizationService.java:run(973)) - Public cache exiting 2017-12-14 11:46:06,979 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:06,990 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:06,990 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:06,990 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:06,990 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:06,994 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:06,998 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:07,002 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:07,011 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:07,011 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:07,012 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:07,012 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:07,012 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:07,012 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:07,012 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:07,012 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:07,013 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:07,013 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:07,013 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:07,013 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:07,013 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:07,024 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:07,024 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:07,025 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@6986852 2017-12-14 11:46:07,025 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:07,025 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:07,025 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:07,025 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:07,025 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:07,025 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:07,025 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:07,025 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:07,026 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:07,026 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:07,026 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:07,026 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:07,030 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:07,039 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:07,039 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:07,040 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:07,040 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:07,044 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:07,048 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:07,051 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:07,060 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:07,060 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:07,060 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:07,060 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:07,060 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:07,060 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:07,061 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:07,061 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:07,062 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:07,062 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:07,062 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:07,062 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:07,062 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:07,073 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:07,074 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:07,074 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@67b9b51a 2017-12-14 11:46:07,074 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:07,074 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:07,074 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:07,074 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:07,075 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:07,075 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:07,075 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:07,075 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:07,075 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:07,075 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:07,075 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:07,075 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:07,112 ERROR [main] launcher.ContainerLaunch (ContainerLaunch.java:call(302)) - Failed to launch container due to configuration error. org.apache.hadoop.yarn.exceptions.ConfigurationException: Mock configuration error at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:467) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:287) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.testContainerLaunchOnConfigurationError(TestContainerLaunch.java:1602) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) 2017-12-14 11:46:07,132 WARN [main] launcher.ContainerLaunch (ContainerLaunch.java:call(310)) - Failed to launch container. java.io.IOException: Mock configuration error at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:467) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:287) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.testContainerLaunchOnConfigurationError(TestContainerLaunch.java:1614) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) 2017-12-14 11:46:07,138 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:07,147 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:07,147 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:07,147 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:07,147 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:07,151 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:07,155 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:07,159 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:07,168 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:07,168 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:07,168 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:07,168 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:07,168 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:07,168 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:07,169 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:07,169 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:07,170 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:07,170 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:07,170 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:07,170 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:07,170 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:07,182 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:07,183 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:07,183 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@6d07a63d 2017-12-14 11:46:07,183 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:07,183 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:07,183 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:07,183 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:07,184 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:07,184 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:07,184 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:07,184 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:07,184 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:07,184 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:07,184 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:07,185 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:07,185 INFO [Thread-202] ipc.CallQueueManager (CallQueueManager.java:(84)) - Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 2000 scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler 2017-12-14 11:46:07,186 INFO [Socket Reader #1 for port 49162] ipc.Server (Server.java:run(1067)) - Starting Socket Reader #1 for port 49162 2017-12-14 11:46:07,187 INFO [Thread-202] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(173)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server 2017-12-14 11:46:07,188 INFO [IPC Server listener on 49162] ipc.Server (Server.java:run(1146)) - IPC Server listener on 49162: starting 2017-12-14 11:46:07,188 INFO [IPC Server Responder] ipc.Server (Server.java:run(1307)) - IPC Server Responder: starting 2017-12-14 11:46:07,192 INFO [Thread-202] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(260)) - Updating node address : localhost:49162 2017-12-14 11:46:07,193 INFO [Thread-202] ipc.CallQueueManager (CallQueueManager.java:(84)) - Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 500 scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler 2017-12-14 11:46:07,194 INFO [Socket Reader #1 for port 8040] ipc.Server (Server.java:run(1067)) - Starting Socket Reader #1 for port 8040 2017-12-14 11:46:07,194 INFO [Thread-202] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(173)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server 2017-12-14 11:46:07,195 INFO [IPC Server Responder] ipc.Server (Server.java:run(1307)) - IPC Server Responder: starting 2017-12-14 11:46:07,195 INFO [IPC Server listener on 8040] ipc.Server (Server.java:run(1146)) - IPC Server listener on 8040: starting 2017-12-14 11:46:07,196 INFO [Thread-202] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(385)) - Localizer started on port 8040 2017-12-14 11:46:07,203 INFO [Thread-202] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(655)) - ContainerManager started at localhost/127.0.0.1:49162 2017-12-14 11:46:07,203 INFO [Thread-202] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(656)) - ContainerManager bound to 0.0.0.0/0.0.0.0:49162 2017-12-14 11:46:07,208 INFO [Thread-202] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(1059)) - Start request for container_1_0001_01_000000 by user nobody 2017-12-14 11:46:07,208 INFO [Thread-202] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(1127)) - Creating a new application reference for app application_1_0001 2017-12-14 11:46:07,209 INFO [Thread-202] nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(94)) - USER=nobody OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1_0001 CONTAINERID=container_1_0001_01_000000 2017-12-14 11:46:07,209 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:handle(632)) - Application application_1_0001 transitioned from NEW to INITING 2017-12-14 11:46:07,209 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:transition(446)) - Adding container_1_0001_01_000000 to application application_1_0001 2017-12-14 11:46:07,209 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:handle(632)) - Application application_1_0001 transitioned from INITING to RUNNING 2017-12-14 11:46:07,209 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_1_0001_01_000000 transitioned from NEW to LOCALIZING 2017-12-14 11:46:07,209 INFO [NM ContainerManager dispatcher] containermanager.AuxServices (AuxServices.java:handle(220)) - Got event CONTAINER_INIT for appId application_1_0001 2017-12-14 11:46:07,210 INFO [NM ContainerManager dispatcher] localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(791)) - Created localizer for container_1_0001_01_000000 2017-12-14 11:46:07,213 INFO [LocalizerRunner for container_1_0001_01_000000] localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1322)) - Writing credentials to the nmPrivate file /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/nmPrivate/container_1_0001_01_000000.tokens 2017-12-14 11:46:07,214 INFO [LocalizerRunner for container_1_0001_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(827)) - Initializing user nobody 2017-12-14 11:46:07,216 INFO [LocalizerRunner for container_1_0001_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(167)) - Copying from /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/nmPrivate/container_1_0001_01_000000.tokens to /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_1_0001/container_1_0001_01_000000.tokens 2017-12-14 11:46:07,217 INFO [LocalizerRunner for container_1_0001_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(175)) - Localizer CWD set to /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_1_0001 = file:/home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_1_0001 2017-12-14 11:46:07,220 INFO [LocalizerRunner for container_1_0001_01_000000] localizer.ContainerLocalizer (ContainerLocalizer.java:(140)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:07,235 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_1_0001_01_000000 transitioned from LOCALIZING to SCHEDULED 2017-12-14 11:46:07,235 INFO [NM ContainerManager dispatcher] scheduler.ContainerScheduler (ContainerScheduler.java:startContainer(491)) - Starting container [container_1_0001_01_000000] 2017-12-14 11:46:07,249 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_1_0001_01_000000 transitioned from SCHEDULED to RUNNING 2017-12-14 11:46:07,249 INFO [NM ContainerManager dispatcher] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:onStartMonitoringContainer(907)) - Starting resource-monitoring for container_1_0001_01_000000 2017-12-14 11:46:07,254 INFO [ContainersLauncher #0] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(365)) - launchContainer: [bash, /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_1_0001/container_1_0001_01_000000/default_container_executor.sh] 2017-12-14 11:46:08,210 INFO [Thread-202] containermanager.BaseContainerManagerTest (TestContainerLaunch.java:internalKillTest(1113)) - Waiting for process start-file to be created 2017-12-14 11:46:08,210 INFO [Thread-202] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(1365)) - Stopping container with container Id: container_1_0001_01_000000 2017-12-14 11:46:08,210 INFO [Thread-202] nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(94)) - USER=nobody OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1_0001 CONTAINERID=container_1_0001_01_000000 2017-12-14 11:46:08,211 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_1_0001_01_000000 transitioned from RUNNING to KILLING 2017-12-14 11:46:08,211 INFO [NM ContainerManager dispatcher] launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(670)) - Cleaning up container container_1_0001_01_000000 2017-12-14 11:46:08,245 INFO [LocalizerRunner for container_1_0001_01_000000] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:09,211 INFO [Thread-202] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1419)) - Getting container-status for container_1_0001_01_000000 2017-12-14 11:46:09,211 INFO [Thread-202] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1433)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, ExecutionType: GUARANTEED, State: RUNNING, Capability: , Diagnostics: [2017-12-14 11:46:08.211]Container killed by the ApplicationMaster.[2017-12-14 11:46:08.211] , ExitStatus: -105, IP: null, Host: null, ContainerSubState: RUNNING] 2017-12-14 11:46:09,211 INFO [Thread-202] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(319)) - Waiting for container to get into one of states [COMPLETE]. Current state is RUNNING 2017-12-14 11:46:09,225 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(306)) - Exit code from container container_1_0001_01_000000 is : 137 2017-12-14 11:46:09,225 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_1_0001_01_000000 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-12-14 11:46:09,226 INFO [NM ContainerManager dispatcher] localizer.ResourceLocalizationService (ResourceLocalizationService.java:cleanupPrivLocalizers(812)) - Interrupting localizer for container_1_0001_01_000000 2017-12-14 11:46:09,226 INFO [NM ContainerManager dispatcher] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:09,226 INFO [NM ContainerManager dispatcher] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:09,226 INFO [NM ContainerManager dispatcher] nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(94)) - USER=nobody OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1_0001 CONTAINERID=container_1_0001_01_000000 2017-12-14 11:46:09,227 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_1_0001_01_000000 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-12-14 11:46:09,227 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:transition(489)) - Removing container_1_0001_01_000000 from application application_1_0001 2017-12-14 11:46:09,227 INFO [NM ContainerManager dispatcher] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:onStopMonitoringContainer(898)) - Stopping resource-monitoring for container_1_0001_01_000000 2017-12-14 11:46:09,227 INFO [NM ContainerManager dispatcher] containermanager.AuxServices (AuxServices.java:handle(220)) - Got event CONTAINER_STOP for appId application_1_0001 2017-12-14 11:46:10,212 INFO [Thread-202] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1419)) - Getting container-status for container_1_0001_01_000000 2017-12-14 11:46:10,213 INFO [Thread-202] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1433)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, ExecutionType: GUARANTEED, State: COMPLETE, Capability: , Diagnostics: [2017-12-14 11:46:08.211]Container killed by the ApplicationMaster.[2017-12-14 11:46:08.211] [2017-12-14 11:46:09.225]Container killed on request. Exit code is 137[2017-12-14 11:46:09.225] [2017-12-14 11:46:09.225]Container exited with a non-zero exit code 137. [2017-12-14 11:46:09.225] , ExitStatus: -105, IP: null, Host: null, ContainerSubState: DONE] 2017-12-14 11:46:10,213 INFO [Thread-202] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(319)) - Waiting for container to get into one of states [COMPLETE]. Current state is COMPLETE 2017-12-14 11:46:10,213 INFO [Thread-202] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(324)) - Container state is COMPLETE 2017-12-14 11:46:10,213 INFO [Thread-202] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1419)) - Getting container-status for container_1_0001_01_000000 2017-12-14 11:46:10,213 INFO [Thread-202] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1433)) - Returning ContainerStatus: [ContainerId: container_1_0001_01_000000, ExecutionType: GUARANTEED, State: COMPLETE, Capability: , Diagnostics: [2017-12-14 11:46:08.211]Container killed by the ApplicationMaster.[2017-12-14 11:46:08.211] [2017-12-14 11:46:09.225]Container killed on request. Exit code is 137[2017-12-14 11:46:09.225] [2017-12-14 11:46:09.225]Container exited with a non-zero exit code 137. [2017-12-14 11:46:09.225] , ExitStatus: -105, IP: null, Host: null, ContainerSubState: DONE] 2017-12-14 11:46:10,214 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(701)) - Applications still running : [application_1_0001] 2017-12-14 11:46:10,214 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(717)) - Waiting for Applications to be Finished 2017-12-14 11:46:10,214 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:handle(632)) - Application application_1_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP 2017-12-14 11:46:10,214 INFO [NM ContainerManager dispatcher] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:10,214 INFO [NM ContainerManager dispatcher] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:10,215 INFO [NM ContainerManager dispatcher] containermanager.AuxServices (AuxServices.java:handle(220)) - Got event APPLICATION_STOP for appId application_1_0001 2017-12-14 11:46:10,215 ERROR [NM ContainerManager dispatcher] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:appFinished(203)) - No application Attempt for application : application_1_0001 started on this NM. 2017-12-14 11:46:10,215 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:handle(632)) - Application application_1_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED 2017-12-14 11:46:10,215 INFO [NM ContainerManager dispatcher] loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(169)) - Scheduling Log Deletion for application: application_1_0001, with delay of 1 seconds 2017-12-14 11:46:11,217 INFO [LogDeleter #0] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:12,217 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(732)) - All applications in FINISHED state 2017-12-14 11:46:12,218 INFO [main] ipc.Server (Server.java:stop(3074)) - Stopping server on 49162 2017-12-14 11:46:12,219 INFO [IPC Server Responder] ipc.Server (Server.java:run(1312)) - Stopping IPC Server Responder 2017-12-14 11:46:12,219 INFO [IPC Server listener on 49162] ipc.Server (Server.java:run(1178)) - Stopping IPC Server listener on 49162 2017-12-14 11:46:12,220 WARN [Container Monitor] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(494)) - org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is interrupted. Exiting. 2017-12-14 11:46:12,221 INFO [main] ipc.Server (Server.java:stop(3074)) - Stopping server on 8040 2017-12-14 11:46:12,221 INFO [IPC Server listener on 8040] ipc.Server (Server.java:run(1178)) - Stopping IPC Server listener on 8040 2017-12-14 11:46:12,221 INFO [IPC Server Responder] ipc.Server (Server.java:run(1312)) - Stopping IPC Server Responder 2017-12-14 11:46:12,221 INFO [Public Localizer] localizer.ResourceLocalizationService (ResourceLocalizationService.java:run(973)) - Public cache exiting 2017-12-14 11:46:12,226 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:12,237 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:12,237 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:12,237 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:12,237 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:12,241 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:12,245 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,249 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,259 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:12,259 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:12,259 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:12,259 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:12,259 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:12,259 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:12,259 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:12,260 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:12,260 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:12,260 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:12,260 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:12,260 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:12,261 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:12,273 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,273 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:12,274 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@6c2ed0cd 2017-12-14 11:46:12,274 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:12,274 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:12,274 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:12,274 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:12,274 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:12,274 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:12,274 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:12,274 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:12,275 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:12,275 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:12,275 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:12,275 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of Received an expected exception: /bin/bash: unknownCommand: command not found 2017-12-14 11:46:12,284 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:12,295 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:12,295 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:12,295 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:12,295 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:12,300 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:12,304 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,307 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,316 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:12,316 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:12,317 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:12,317 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:12,317 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:12,317 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:12,317 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:12,317 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:12,318 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:12,318 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:12,318 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:12,318 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:12,318 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:12,330 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,331 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:12,331 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@413f69cc 2017-12-14 11:46:12,331 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:12,331 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:12,331 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:12,331 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:12,332 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:12,332 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:12,332 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:12,332 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:12,332 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:12,332 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:12,332 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:12,332 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:12,340 INFO [Thread-263] runtime.DockerLinuxContainerRuntime (DockerLinuxContainerRuntime.java:(258)) - cGroupsHandler is null - cgroups not in use. 2017-12-14 11:46:12,352 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:12,361 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:12,361 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:12,362 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:12,362 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:12,366 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:12,370 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,373 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,381 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:12,381 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:12,381 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:12,381 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:12,382 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:12,382 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:12,382 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:12,382 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:12,383 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:12,383 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:12,383 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:12,383 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:12,383 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:12,394 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,394 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:12,394 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@6cc558c6 2017-12-14 11:46:12,395 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:12,395 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:12,395 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:12,395 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:12,395 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:12,395 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:12,395 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:12,395 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:12,396 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:12,396 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:12,396 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:12,396 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:12,425 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(365)) - launchContainer: [bash, /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/test/appcache/application_1513269972400_0001/container_1513269972400_0001_01_000001/default_container_executor.sh] 2017-12-14 11:46:12,437 WARN [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(306)) - Exit code from container container_1513269972400_0001_01_000001 is : 127 2017-12-14 11:46:12,437 WARN [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(312)) - Exception from container-launch with container ID: container_1513269972400_0001_01_000001 and exit code: 127 ExitCodeException exitCode=127: at org.apache.hadoop.util.Shell.runCommand(Shell.java:994) at org.apache.hadoop.util.Shell.run(Shell.java:887) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1212) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:295) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor$$EnhancerByMockitoWithCGLIB$$3ff969cf.CGLIB$launchContainer$1() at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor$$EnhancerByMockitoWithCGLIB$$3ff969cf$$FastClassByMockitoWithCGLIB$$72cfd232.invoke() at org.mockito.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:216) at org.mockito.internal.creation.AbstractMockitoMethodProxy.invokeSuper(AbstractMockitoMethodProxy.java:10) at org.mockito.internal.invocation.realmethod.CGLIBProxyRealMethod.invoke(CGLIBProxyRealMethod.java:22) at org.mockito.internal.invocation.realmethod.FilteredCGLIBProxyRealMethod.invoke(FilteredCGLIBProxyRealMethod.java:27) at org.mockito.internal.invocation.Invocation.callRealMethod(Invocation.java:211) at org.mockito.internal.stubbing.answers.CallsRealMethods.answer(CallsRealMethods.java:36) at org.mockito.internal.MockHandler.handle(MockHandler.java:99) at org.mockito.internal.creation.MethodInterceptorFilter.intercept(MethodInterceptorFilter.java:47) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor$$EnhancerByMockitoWithCGLIB$$3ff969cf.launchContainer() at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:467) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:287) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.verifyTailErrorLogOnContainerExit(TestContainerLaunch.java:716) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.testErrorLogOnContainerExitWithCustomPattern(TestContainerLaunch.java:640) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) 2017-12-14 11:46:12,438 INFO [main] nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(483)) - Exception from container-launch. 2017-12-14 11:46:12,438 INFO [main] nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(483)) - Container id: container_1513269972400_0001_01_000001 2017-12-14 11:46:12,438 INFO [main] nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(483)) - Exit code: 127 2017-12-14 11:46:12,439 WARN [main] launcher.ContainerLaunch (ContainerLaunch.java:handleContainerExitWithFailure(534)) - Container launch failed : Container exited with a non-zero exit code 127. 2017-12-14 11:46:12,442 INFO [main] containermanager.BaseContainerManagerTest (TestContainerLaunch.java:handle(740)) - Diagnostic Info : Container exited with a non-zero exit code 127. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of error.log : /bin/bash: /no/jvm/here/bin/java: No such file or directory 2017-12-14 11:46:12,447 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:12,457 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:12,457 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:12,457 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:12,457 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:12,462 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:12,466 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,470 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,478 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:12,478 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:12,478 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:12,478 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:12,478 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:12,478 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:12,478 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:12,479 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:12,479 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:12,479 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:12,480 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:12,480 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:12,480 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:12,491 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,491 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:12,491 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@61544ae6 2017-12-14 11:46:12,491 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:12,492 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:12,492 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:12,492 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:12,492 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:12,492 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:12,492 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:12,492 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:12,492 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:12,493 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:12,493 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:12,493 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:12,497 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:12,507 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:12,507 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:12,507 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:12,508 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:12,513 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:12,517 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,520 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,529 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:12,529 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:12,529 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:12,529 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:12,529 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:12,529 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:12,530 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:12,530 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:12,531 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:12,531 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:12,531 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:12,531 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:12,531 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:12,542 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,542 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:12,542 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@49ff7d8c 2017-12-14 11:46:12,542 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:12,542 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:12,543 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:12,543 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:12,543 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:12,543 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:12,543 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:12,543 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:12,543 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:12,543 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:12,544 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:12,544 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:12,548 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:12,558 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:12,558 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:12,559 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:12,559 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:12,563 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:12,567 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,571 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,578 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:12,579 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:12,579 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:12,579 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:12,579 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:12,579 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:12,579 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:12,579 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:12,580 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:12,580 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:12,580 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:12,580 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:12,580 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:12,591 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,592 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:12,592 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@19e4fcac 2017-12-14 11:46:12,592 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:12,592 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:12,592 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:12,592 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:12,592 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:12,593 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:12,593 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:12,593 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:12,593 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:12,593 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:12,593 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:12,593 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:12,641 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(365)) - launchContainer: [bash, /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/test/appcache/application_1513269972593_0001/container_1513269972593_0001_01_000001/default_container_executor.sh] 2017-12-14 11:46:12,652 WARN [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(306)) - Exit code from container container_1513269972593_0001_01_000001 is : 127 2017-12-14 11:46:12,652 WARN [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(312)) - Exception from container-launch with container ID: container_1513269972593_0001_01_000001 and exit code: 127 ExitCodeException exitCode=127: at org.apache.hadoop.util.Shell.runCommand(Shell.java:994) at org.apache.hadoop.util.Shell.run(Shell.java:887) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1212) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:295) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor$$EnhancerByMockitoWithCGLIB$$3ff969cf.CGLIB$launchContainer$1() at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor$$EnhancerByMockitoWithCGLIB$$3ff969cf$$FastClassByMockitoWithCGLIB$$72cfd232.invoke() at org.mockito.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:216) at org.mockito.internal.creation.AbstractMockitoMethodProxy.invokeSuper(AbstractMockitoMethodProxy.java:10) at org.mockito.internal.invocation.realmethod.CGLIBProxyRealMethod.invoke(CGLIBProxyRealMethod.java:22) at org.mockito.internal.invocation.realmethod.FilteredCGLIBProxyRealMethod.invoke(FilteredCGLIBProxyRealMethod.java:27) at org.mockito.internal.invocation.Invocation.callRealMethod(Invocation.java:211) at org.mockito.internal.stubbing.answers.CallsRealMethods.answer(CallsRealMethods.java:36) at org.mockito.internal.MockHandler.handle(MockHandler.java:99) at org.mockito.internal.creation.MethodInterceptorFilter.intercept(MethodInterceptorFilter.java:47) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor$$EnhancerByMockitoWithCGLIB$$3ff969cf.launchContainer() at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:467) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:287) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.verifyTailErrorLogOnContainerExit(TestContainerLaunch.java:716) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.testErrorLogOnContainerExitForCase(TestContainerLaunch.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) 2017-12-14 11:46:12,652 INFO [main] nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(483)) - Exception from container-launch. 2017-12-14 11:46:12,653 INFO [main] nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(483)) - Container id: container_1513269972593_0001_01_000001 2017-12-14 11:46:12,653 INFO [main] nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(483)) - Exit code: 127 2017-12-14 11:46:12,653 WARN [main] launcher.ContainerLaunch (ContainerLaunch.java:handleContainerExitWithFailure(534)) - Container launch failed : Container exited with a non-zero exit code 127. 2017-12-14 11:46:12,656 INFO [main] containermanager.BaseContainerManagerTest (TestContainerLaunch.java:handle(740)) - Diagnostic Info : Container exited with a non-zero exit code 127. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of STDERR.log : /bin/bash: /no/jvm/here/bin/java: No such file or directory 2017-12-14 11:46:12,660 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:12,672 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:12,672 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:12,672 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:12,672 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:12,677 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:12,681 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,685 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,694 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:12,694 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:12,694 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:12,694 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:12,694 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:12,695 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:12,695 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:12,695 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:12,696 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:12,696 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:12,696 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:12,696 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:12,696 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:12,708 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,709 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:12,709 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@53de625d 2017-12-14 11:46:12,709 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:12,709 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:12,709 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:12,709 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:12,710 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:12,710 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:12,710 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:12,710 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:12,710 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:12,710 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:12,711 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:12,711 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:12,713 INFO [main] ipc.CallQueueManager (CallQueueManager.java:(84)) - Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 2000 scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler 2017-12-14 11:46:12,714 INFO [Socket Reader #1 for port 49162] ipc.Server (Server.java:run(1067)) - Starting Socket Reader #1 for port 49162 2017-12-14 11:46:12,714 INFO [main] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(173)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server 2017-12-14 11:46:12,715 INFO [IPC Server Responder] ipc.Server (Server.java:run(1307)) - IPC Server Responder: starting 2017-12-14 11:46:12,715 INFO [IPC Server listener on 49162] ipc.Server (Server.java:run(1146)) - IPC Server listener on 49162: starting 2017-12-14 11:46:12,723 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(260)) - Updating node address : localhost:49162 2017-12-14 11:46:12,723 INFO [main] ipc.CallQueueManager (CallQueueManager.java:(84)) - Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 500 scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler 2017-12-14 11:46:12,724 INFO [Socket Reader #1 for port 8040] ipc.Server (Server.java:run(1067)) - Starting Socket Reader #1 for port 8040 2017-12-14 11:46:12,724 INFO [main] pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(173)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server 2017-12-14 11:46:12,725 INFO [IPC Server Responder] ipc.Server (Server.java:run(1307)) - IPC Server Responder: starting 2017-12-14 11:46:12,725 INFO [IPC Server listener on 8040] ipc.Server (Server.java:run(1146)) - IPC Server listener on 8040: starting 2017-12-14 11:46:12,726 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(385)) - Localizer started on port 8040 2017-12-14 11:46:12,734 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(655)) - ContainerManager started at localhost/127.0.0.1:49162 2017-12-14 11:46:12,734 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(656)) - ContainerManager bound to 0.0.0.0/0.0.0.0:49162 2017-12-14 11:46:12,736 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(1059)) - Start request for container_2_0002_01_000000 by user nobody 2017-12-14 11:46:12,737 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(1127)) - Creating a new application reference for app application_2_0002 2017-12-14 11:46:12,737 INFO [main] nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(94)) - USER=nobody OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_2_0002 CONTAINERID=container_2_0002_01_000000 2017-12-14 11:46:12,738 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:handle(632)) - Application application_2_0002 transitioned from NEW to INITING 2017-12-14 11:46:12,738 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:transition(446)) - Adding container_2_0002_01_000000 to application application_2_0002 2017-12-14 11:46:12,738 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:handle(632)) - Application application_2_0002 transitioned from INITING to RUNNING 2017-12-14 11:46:12,738 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_2_0002_01_000000 transitioned from NEW to LOCALIZING 2017-12-14 11:46:12,738 INFO [NM ContainerManager dispatcher] containermanager.AuxServices (AuxServices.java:handle(220)) - Got event CONTAINER_INIT for appId application_2_0002 2017-12-14 11:46:12,738 INFO [NM ContainerManager dispatcher] localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(791)) - Created localizer for container_2_0002_01_000000 2017-12-14 11:46:12,742 INFO [LocalizerRunner for container_2_0002_01_000000] localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1322)) - Writing credentials to the nmPrivate file /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/nmPrivate/container_2_0002_01_000000.tokens 2017-12-14 11:46:12,743 INFO [LocalizerRunner for container_2_0002_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(827)) - Initializing user nobody 2017-12-14 11:46:12,745 INFO [LocalizerRunner for container_2_0002_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(167)) - Copying from /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/nmPrivate/container_2_0002_01_000000.tokens to /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_2_0002/container_2_0002_01_000000.tokens 2017-12-14 11:46:12,746 INFO [LocalizerRunner for container_2_0002_01_000000] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(175)) - Localizer CWD set to /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_2_0002 = file:/home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_2_0002 2017-12-14 11:46:12,750 INFO [LocalizerRunner for container_2_0002_01_000000] localizer.ContainerLocalizer (ContainerLocalizer.java:(140)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:12,767 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_2_0002_01_000000 transitioned from LOCALIZING to SCHEDULED 2017-12-14 11:46:12,768 INFO [NM ContainerManager dispatcher] scheduler.ContainerScheduler (ContainerScheduler.java:startContainer(491)) - Starting container [container_2_0002_01_000000] 2017-12-14 11:46:12,783 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_2_0002_01_000000 transitioned from SCHEDULED to RUNNING 2017-12-14 11:46:12,783 INFO [NM ContainerManager dispatcher] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:onStartMonitoringContainer(907)) - Starting resource-monitoring for container_2_0002_01_000000 2017-12-14 11:46:12,788 INFO [ContainersLauncher #0] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(365)) - launchContainer: [bash, /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/nobody/appcache/application_2_0002/container_2_0002_01_000000/default_container_executor.sh] 2017-12-14 11:46:13,739 INFO [main] containermanager.BaseContainerManagerTest (TestContainerLaunch.java:testKillProcessGroup(1453)) - Waiting for process start-file to be created 2017-12-14 11:46:13,739 INFO [main] containermanager.BaseContainerManagerTest (TestContainerLaunch.java:testKillProcessGroup(1474)) - Manually killing pid 11492, but not child pid 11495 2017-12-14 11:46:13,743 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(306)) - Exit code from container container_2_0002_01_000000 is : 137 2017-12-14 11:46:13,744 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_2_0002_01_000000 transitioned from RUNNING to EXITED_WITH_FAILURE 2017-12-14 11:46:13,744 INFO [NM ContainerManager dispatcher] launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(670)) - Cleaning up container container_2_0002_01_000000 2017-12-14 11:46:13,753 INFO [NM ContainerManager dispatcher] localizer.ResourceLocalizationService (ResourceLocalizationService.java:cleanupPrivLocalizers(812)) - Interrupting localizer for container_2_0002_01_000000 2017-12-14 11:46:13,753 INFO [NM ContainerManager dispatcher] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:13,753 INFO [NM ContainerManager dispatcher] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:13,753 INFO [LocalizerRunner for container_2_0002_01_000000] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:13,754 WARN [NM ContainerManager dispatcher] nodemanager.NMAuditLogger (NMAuditLogger.java:logFailure(155)) - USER=nobody OPERATION=Container Finished - Failed TARGET=ContainerImpl RESULT=FAILURE DESCRIPTION=Container failed with state: EXITED_WITH_FAILURE APPID=application_2_0002 CONTAINERID=container_2_0002_01_000000 2017-12-14 11:46:13,754 INFO [NM ContainerManager dispatcher] container.ContainerImpl (ContainerImpl.java:handle(2088)) - Container container_2_0002_01_000000 transitioned from EXITED_WITH_FAILURE to DONE 2017-12-14 11:46:13,754 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:transition(489)) - Removing container_2_0002_01_000000 from application application_2_0002 2017-12-14 11:46:13,754 INFO [NM ContainerManager dispatcher] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:onStopMonitoringContainer(898)) - Stopping resource-monitoring for container_2_0002_01_000000 2017-12-14 11:46:13,754 INFO [NM ContainerManager dispatcher] containermanager.AuxServices (AuxServices.java:handle(220)) - Got event CONTAINER_STOP for appId application_2_0002 2017-12-14 11:46:14,742 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1419)) - Getting container-status for container_2_0002_01_000000 2017-12-14 11:46:14,743 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1433)) - Returning ContainerStatus: [ContainerId: container_2_0002_01_000000, ExecutionType: GUARANTEED, State: COMPLETE, Capability: , Diagnostics: [2017-12-14 11:46:13.743]Container killed on request. Exit code is 137[2017-12-14 11:46:13.743] [2017-12-14 11:46:13.744]Container exited with a non-zero exit code 137. [2017-12-14 11:46:13.744] [2017-12-14 11:46:13.744]Killed by external signal , ExitStatus: 137, IP: null, Host: null, ContainerSubState: DONE] 2017-12-14 11:46:14,743 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(319)) - Waiting for container to get into one of states [COMPLETE]. Current state is COMPLETE 2017-12-14 11:46:14,743 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:waitForContainerState(324)) - Container state is COMPLETE 2017-12-14 11:46:14,746 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1419)) - Getting container-status for container_2_0002_01_000000 2017-12-14 11:46:14,746 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:getContainerStatusInternal(1433)) - Returning ContainerStatus: [ContainerId: container_2_0002_01_000000, ExecutionType: GUARANTEED, State: COMPLETE, Capability: , Diagnostics: [2017-12-14 11:46:13.743]Container killed on request. Exit code is 137[2017-12-14 11:46:13.743] [2017-12-14 11:46:13.744]Container exited with a non-zero exit code 137. [2017-12-14 11:46:13.744] [2017-12-14 11:46:13.744]Killed by external signal , ExitStatus: 137, IP: null, Host: null, ContainerSubState: DONE] 2017-12-14 11:46:14,746 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(701)) - Applications still running : [application_2_0002] 2017-12-14 11:46:14,747 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(717)) - Waiting for Applications to be Finished 2017-12-14 11:46:14,747 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:handle(632)) - Application application_2_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP 2017-12-14 11:46:14,747 INFO [NM ContainerManager dispatcher] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:14,747 INFO [NM ContainerManager dispatcher] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:14,747 INFO [NM ContainerManager dispatcher] containermanager.AuxServices (AuxServices.java:handle(220)) - Got event APPLICATION_STOP for appId application_2_0002 2017-12-14 11:46:14,747 ERROR [NM ContainerManager dispatcher] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:appFinished(203)) - No application Attempt for application : application_2_0002 started on this NM. 2017-12-14 11:46:14,747 INFO [NM ContainerManager dispatcher] application.ApplicationImpl (ApplicationImpl.java:handle(632)) - Application application_2_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED 2017-12-14 11:46:14,747 INFO [NM ContainerManager dispatcher] loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(169)) - Scheduling Log Deletion for application: application_2_0002, with delay of 1 seconds 2017-12-14 11:46:15,751 INFO [LogDeleter #0] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:delete(268)) - Psuedo delete: user - nobody, type - FILE 2017-12-14 11:46:16,752 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:cleanUpApplicationsOnNMShutDown(732)) - All applications in FINISHED state 2017-12-14 11:46:16,752 INFO [main] ipc.Server (Server.java:stop(3074)) - Stopping server on 49162 2017-12-14 11:46:16,753 INFO [IPC Server listener on 49162] ipc.Server (Server.java:run(1178)) - Stopping IPC Server listener on 49162 2017-12-14 11:46:16,753 INFO [IPC Server Responder] ipc.Server (Server.java:run(1312)) - Stopping IPC Server Responder 2017-12-14 11:46:16,754 WARN [Container Monitor] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(494)) - org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is interrupted. Exiting. 2017-12-14 11:46:16,755 INFO [main] ipc.Server (Server.java:stop(3074)) - Stopping server on 8040 2017-12-14 11:46:16,756 INFO [IPC Server listener on 8040] ipc.Server (Server.java:run(1178)) - Stopping IPC Server listener on 8040 2017-12-14 11:46:16,756 INFO [Public Localizer] localizer.ResourceLocalizationService (ResourceLocalizationService.java:run(973)) - Public cache exiting 2017-12-14 11:46:16,756 INFO [IPC Server Responder] ipc.Server (Server.java:run(1312)) - Stopping IPC Server Responder 2017-12-14 11:46:16,761 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:16,772 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:16,772 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:16,772 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:16,772 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:16,776 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:16,780 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:16,783 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:16,794 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:16,794 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:16,794 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:16,794 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:16,794 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:16,794 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:16,794 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:16,794 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:16,795 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:16,795 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:16,795 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:16,795 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:16,795 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:16,806 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:16,806 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:16,807 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@1a6c1270 2017-12-14 11:46:16,807 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:16,807 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:16,807 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:16,807 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:16,807 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:16,807 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:16,807 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:16,807 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:16,808 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:16,808 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:16,808 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:16,808 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:16,836 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(365)) - launchContainer: [bash, /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/test/appcache/application_1513269976808_0001/container_1513269976808_0001_01_000001/default_container_executor.sh] 2017-12-14 11:46:16,847 WARN [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(306)) - Exit code from container container_1513269976808_0001_01_000001 is : 127 2017-12-14 11:46:16,847 WARN [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(312)) - Exception from container-launch with container ID: container_1513269976808_0001_01_000001 and exit code: 127 ExitCodeException exitCode=127: at org.apache.hadoop.util.Shell.runCommand(Shell.java:994) at org.apache.hadoop.util.Shell.run(Shell.java:887) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1212) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:295) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor$$EnhancerByMockitoWithCGLIB$$3ff969cf.CGLIB$launchContainer$1() at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor$$EnhancerByMockitoWithCGLIB$$3ff969cf$$FastClassByMockitoWithCGLIB$$72cfd232.invoke() at org.mockito.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:216) at org.mockito.internal.creation.AbstractMockitoMethodProxy.invokeSuper(AbstractMockitoMethodProxy.java:10) at org.mockito.internal.invocation.realmethod.CGLIBProxyRealMethod.invoke(CGLIBProxyRealMethod.java:22) at org.mockito.internal.invocation.realmethod.FilteredCGLIBProxyRealMethod.invoke(FilteredCGLIBProxyRealMethod.java:27) at org.mockito.internal.invocation.Invocation.callRealMethod(Invocation.java:211) at org.mockito.internal.stubbing.answers.CallsRealMethods.answer(CallsRealMethods.java:36) at org.mockito.internal.MockHandler.handle(MockHandler.java:99) at org.mockito.internal.creation.MethodInterceptorFilter.intercept(MethodInterceptorFilter.java:47) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor$$EnhancerByMockitoWithCGLIB$$3ff969cf.launchContainer() at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:467) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:287) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.verifyTailErrorLogOnContainerExit(TestContainerLaunch.java:716) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.testErrorLogOnContainerExit(TestContainerLaunch.java:620) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) 2017-12-14 11:46:16,848 INFO [main] nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(483)) - Exception from container-launch. 2017-12-14 11:46:16,848 INFO [main] nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(483)) - Container id: container_1513269976808_0001_01_000001 2017-12-14 11:46:16,848 INFO [main] nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(483)) - Exit code: 127 2017-12-14 11:46:16,848 WARN [main] launcher.ContainerLaunch (ContainerLaunch.java:handleContainerExitWithFailure(534)) - Container launch failed : Container exited with a non-zero exit code 127. 2017-12-14 11:46:16,850 INFO [main] containermanager.BaseContainerManagerTest (TestContainerLaunch.java:handle(740)) - Diagnostic Info : Container exited with a non-zero exit code 127. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : /bin/bash: /no/jvm/here/bin/java: No such file or directory 2017-12-14 11:46:16,855 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:16,865 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:16,865 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:16,866 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:16,866 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:16,869 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:16,873 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:16,876 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:16,885 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:16,885 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:16,885 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:16,885 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:16,885 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:16,885 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:16,885 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:16,885 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:16,886 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:16,886 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:16,886 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:16,886 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:16,886 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:16,897 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:16,898 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:16,898 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@517566b 2017-12-14 11:46:16,898 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:16,898 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:16,899 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:16,899 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:16,899 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:16,899 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:16,899 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:16,899 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:16,899 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:16,899 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:16,900 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:16,900 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of $HADOOP_HOME/share/hadoop/common/*:$HADOOP_HOME/share/hadoop/common/lib/*:$HADOOP_LOG_HOME/nm/container/logs 2017-12-14 11:46:16,904 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:16,912 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:16,913 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:16,913 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:16,913 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:16,916 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:16,920 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:16,923 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:16,931 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:16,931 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:16,931 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:16,931 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:16,931 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:16,931 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:16,931 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:16,932 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:16,932 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:16,932 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:16,932 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:16,933 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:16,933 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:16,944 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:16,945 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:16,945 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@7a1a3478 2017-12-14 11:46:16,945 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:16,945 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:16,945 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:16,945 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:16,946 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:16,946 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:16,946 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:16,946 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:16,946 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:16,946 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:16,946 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:16,947 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:16,963 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:16,973 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:16,973 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:16,973 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:16,973 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:16,977 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:16,981 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:16,985 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:16,996 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:16,996 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:16,996 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:16,996 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:16,996 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:16,996 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:16,996 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:16,997 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:16,997 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:16,997 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:16,997 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:16,997 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:16,997 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:17,008 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:17,009 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:17,009 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@49d3c823 2017-12-14 11:46:17,009 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:17,009 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:17,009 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:17,010 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:17,010 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:17,010 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:17,010 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:17,010 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:17,010 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:17,010 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:17,010 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:17,010 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:17,045 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:17,055 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:17,055 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:17,055 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:17,055 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:17,059 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:17,063 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:17,066 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:17,075 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:17,075 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:17,075 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:17,075 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:17,075 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:17,075 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:17,075 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:17,075 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:17,076 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:17,076 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:17,076 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:17,076 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:17,076 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:17,087 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:17,087 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:17,087 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@373ebf74 2017-12-14 11:46:17,087 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:17,088 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:17,088 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:17,088 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:17,088 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:17,088 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:17,088 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:17,088 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:17,089 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:17,089 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:17,089 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:17,089 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:17,101 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:17,110 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:17,110 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:17,110 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:17,110 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:17,114 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:17,117 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:17,120 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:17,128 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:17,128 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:17,128 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:17,128 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:17,128 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:17,128 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:17,128 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:17,128 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:17,129 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:17,129 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:17,129 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:17,129 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:17,129 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:17,142 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:17,142 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:17,143 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@54c62d71 2017-12-14 11:46:17,143 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:17,143 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:17,143 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:17,143 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:17,143 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:17,144 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:17,144 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:17,144 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:17,144 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:17,144 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:17,144 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:17,144 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:17,170 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(365)) - launchContainer: [bash, /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir/usercache/test/appcache/application_1513269977144_0001/container_1513269977144_0001_01_000001/default_container_executor.sh] 2017-12-14 11:46:17,182 WARN [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(306)) - Exit code from container container_1513269977144_0001_01_000001 is : 127 2017-12-14 11:46:17,182 WARN [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(312)) - Exception from container-launch with container ID: container_1513269977144_0001_01_000001 and exit code: 127 ExitCodeException exitCode=127: at org.apache.hadoop.util.Shell.runCommand(Shell.java:994) at org.apache.hadoop.util.Shell.run(Shell.java:887) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1212) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:295) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor$$EnhancerByMockitoWithCGLIB$$3ff969cf.CGLIB$launchContainer$1() at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor$$EnhancerByMockitoWithCGLIB$$3ff969cf$$FastClassByMockitoWithCGLIB$$72cfd232.invoke() at org.mockito.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:216) at org.mockito.internal.creation.AbstractMockitoMethodProxy.invokeSuper(AbstractMockitoMethodProxy.java:10) at org.mockito.internal.invocation.realmethod.CGLIBProxyRealMethod.invoke(CGLIBProxyRealMethod.java:22) at org.mockito.internal.invocation.realmethod.FilteredCGLIBProxyRealMethod.invoke(FilteredCGLIBProxyRealMethod.java:27) at org.mockito.internal.invocation.Invocation.callRealMethod(Invocation.java:211) at org.mockito.internal.stubbing.answers.CallsRealMethods.answer(CallsRealMethods.java:36) at org.mockito.internal.MockHandler.handle(MockHandler.java:99) at org.mockito.internal.creation.MethodInterceptorFilter.intercept(MethodInterceptorFilter.java:47) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor$$EnhancerByMockitoWithCGLIB$$3ff969cf.launchContainer() at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:467) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:287) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.verifyTailErrorLogOnContainerExit(TestContainerLaunch.java:716) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.testErrorLogOnContainerExitForExt(TestContainerLaunch.java:631) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:369) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:275) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:239) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:160) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:373) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:334) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:119) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:407) 2017-12-14 11:46:17,182 INFO [main] nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(483)) - Exception from container-launch. 2017-12-14 11:46:17,183 INFO [main] nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(483)) - Container id: container_1513269977144_0001_01_000001 2017-12-14 11:46:17,183 INFO [main] nodemanager.ContainerExecutor (ContainerExecutor.java:logOutput(483)) - Exit code: 127 2017-12-14 11:46:17,183 WARN [main] launcher.ContainerLaunch (ContainerLaunch.java:handleContainerExitWithFailure(534)) - Container launch failed : Container exited with a non-zero exit code 127. 2017-12-14 11:46:17,185 INFO [main] containermanager.BaseContainerManagerTest (TestContainerLaunch.java:handle(740)) - Diagnostic Info : Container exited with a non-zero exit code 127. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of AppMaster.stderr : /bin/bash: /no/jvm/here/bin/java: No such file or directory 2017-12-14 11:46:17,189 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:17,199 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:17,199 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:17,199 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:17,199 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:17,203 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:17,207 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:17,210 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:17,218 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:17,218 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:17,218 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:17,218 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:17,218 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:17,218 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:17,219 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:17,219 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:17,219 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:17,220 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:17,220 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:17,220 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:17,220 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:17,230 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:17,231 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:17,231 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@3724af13 2017-12-14 11:46:17,231 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:17,231 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:17,231 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:17,231 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:17,232 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:17,232 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:17,232 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:17,232 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:17,232 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:17,232 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:17,232 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:17,233 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:17,239 WARN [Thread-395] launcher.ContainerLaunch (ContainerLaunch.java:call(310)) - Failed to launch container. org.apache.hadoop.yarn.exceptions.YarnException: Unable to get local resources when Container Mock for Container, hashCode: 1456321706 is at null at org.apache.hadoop.yarn.ipc.RPCUtil.getRemoteException(RPCUtil.java:45) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.getLocalizedResources(ContainerLaunch.java:436) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:185) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch.testCallFailureWithNullLocalizedResources(TestContainerLaunch.java:1206) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74) 2017-12-14 11:46:17,243 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:17,252 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:17,252 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:17,252 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:17,252 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:17,256 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:17,259 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:17,263 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:17,272 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:17,272 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:17,272 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:17,273 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:17,273 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:17,273 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:17,273 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:17,273 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:17,274 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:17,274 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:17,274 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:17,274 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:17,274 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:17,285 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:17,285 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:17,285 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@6f2cfcc2 2017-12-14 11:46:17,285 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:17,286 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:17,286 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:17,286 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:17,286 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:17,286 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:17,286 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:17,286 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:17,286 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:17,287 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:17,287 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:17,287 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:17,305 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:17,314 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(183)) - Created localDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir 2017-12-14 11:46:17,314 INFO [main] containermanager.BaseContainerManagerTest (BaseContainerManagerTest.java:setup(184)) - Created tmpDir in /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-tmpDir 2017-12-14 11:46:17,314 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2017-12-14 11:46:17,314 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2017-12-14 11:46:17,318 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(316)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2017-12-14 11:46:17,321 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:17,324 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(189)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:17,332 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2017-12-14 11:46:17,333 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2017-12-14 11:46:17,333 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2017-12-14 11:46:17,333 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2017-12-14 11:46:17,333 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2017-12-14 11:46:17,333 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2017-12-14 11:46:17,333 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2017-12-14 11:46:17,333 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(192)) - Nodemanager resources is set to: 2017-12-14 11:46:17,334 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(236)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2017-12-14 11:46:17,334 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2017-12-14 11:46:17,334 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2017-12-14 11:46:17,334 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(333)) - AMRMProxyService is disabled 2017-12-14 11:46:17,334 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(239)) - per directory file limit = 8192 2017-12-14 11:46:17,347 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceInit(268)) - Disk Validator: yarn.nodemanager.disk-validator is loaded. 2017-12-14 11:46:17,347 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(223)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2017-12-14 11:46:17,347 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@13e547a9 2017-12-14 11:46:17,347 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(132)) - Using ResourceCalculatorProcessTree : null 2017-12-14 11:46:17,348 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(173)) - Physical memory check enabled: true 2017-12-14 11:46:17,348 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(174)) - Virtual memory check enabled: true 2017-12-14 11:46:17,348 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(178)) - ContainersMonitor enabled: true 2017-12-14 11:46:17,348 WARN [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(198)) - NodeManager configured with 8 G physical memory allocated to containers, which is more than 80% of the total physical memory available (9.6 G). Thrashing might happen. 2017-12-14 11:46:17,348 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(384)) - Not a recoverable state store. Nothing to recover. 2017-12-14 11:46:17,348 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(250)) - Node ID assigned is : null 2017-12-14 11:46:17,348 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(627)) - Sending out 0 NM container statuses: [] 2017-12-14 11:46:17,348 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(382)) - Registering with RM using containers :[] 2017-12-14 11:46:17,348 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:17,349 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(138)) - Rolling master-key for container-tokens, got key with id 123 2017-12-14 11:46:17,349 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(452)) - Registered with ResourceManager as null with total resource of 2017-12-14 11:46:17,364 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(625)) - Deleting absolute path : /home/eyang/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerLaunch-localDir