2019-08-07 10:42:50,867 INFO [main] logaggregation.TestLogAggregationService (BaseContainerManagerTest.java:setup(202)) - Created localDir in /Users/adamantal/git/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestLogAggregationService-localDir 2019-08-07 10:42:50,867 INFO [main] logaggregation.TestLogAggregationService (BaseContainerManagerTest.java:setup(203)) - Created tmpDir in /Users/adamantal/git/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestLogAggregationService-tmpDir 2019-08-07 10:42:50,867 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 49162 2019-08-07 10:42:50,867 INFO [main] net.ServerSocketUtil (ServerSocketUtil.java:getPort(53)) - Using port 8040 2019-08-07 10:42:50,876 INFO [main] nodemanager.NodeManager (NodeManager.java:getNodeHealthScriptRunner(353)) - Node Manager health check script is not available or doesn't have execute permission, so not starting the node health script runner. 2019-08-07 10:42:50,880 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(187)) - Disk Validator 'basic' is loaded. 2019-08-07 10:42:50,883 INFO [main] nodemanager.DirectoryCollection (DirectoryCollection.java:(187)) - Disk Validator 'basic' is loaded. 2019-08-07 10:42:50,884 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(226)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher 2019-08-07 10:42:50,884 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(226)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher 2019-08-07 10:42:50,884 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(226)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$LocalizationEventHandlerWrapper 2019-08-07 10:42:50,884 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(226)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices 2019-08-07 10:42:50,884 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(226)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl 2019-08-07 10:42:50,884 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(226)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher 2019-08-07 10:42:50,884 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(226)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerSchedulerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler.ContainerScheduler 2019-08-07 10:42:50,885 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(203)) - Nodemanager resources is set to: 2019-08-07 10:42:50,885 WARN [main] util.ResourceCalculatorPlugin (ResourceCalculatorPlugin.java:getResourceCalculatorPlugin(194)) - Failed to instantiate default resource calculator. Could not determine OS 2019-08-07 10:42:50,885 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(249)) - Initialized nodemanager with : physical-memory=8192 virtual-memory=17204 virtual-cores=8 2019-08-07 10:42:50,885 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(226)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler 2019-08-07 10:42:50,885 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(226)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService 2019-08-07 10:42:50,885 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:createAMRMProxyService(343)) - AMRMProxyService is disabled 2019-08-07 10:42:50,885 INFO [main] localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(242)) - per directory file limit = 8192 2019-08-07 10:42:50,943 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(226)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker 2019-08-07 10:42:50,944 WARN [main] util.ResourceCalculatorPlugin (ResourceCalculatorPlugin.java:getResourceCalculatorPlugin(194)) - Failed to instantiate default resource calculator. Could not determine OS 2019-08-07 10:42:50,944 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(138)) - Using ResourceCalculatorPlugin: null 2019-08-07 10:42:50,944 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(143)) - Using ResourceCalculatorProcessTree: null 2019-08-07 10:42:50,944 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:setAllocatedResourcesForContainers(913)) - Setting the resources allocated to containers to 2019-08-07 10:42:50,944 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(187)) - Physical memory check enabled: true 2019-08-07 10:42:50,944 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(188)) - Virtual memory check enabled: true 2019-08-07 10:42:50,944 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(189)) - Elastic memory control enabled: false 2019-08-07 10:42:50,944 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(190)) - Strict memory control enabled: true 2019-08-07 10:42:50,944 INFO [main] monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(215)) - ContainersMonitor enabled: true 2019-08-07 10:42:50,944 INFO [main] containermanager.ContainerManagerImpl (ContainerManagerImpl.java:recover(397)) - Not a recoverable state store. Nothing to recover. 2019-08-07 10:42:50,944 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceStart(266)) - Node ID assigned is : null 2019-08-07 10:42:50,944 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNMContainerStatuses(665)) - Sending out 0 NM container statuses: [] 2019-08-07 10:42:50,944 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(400)) - Registering with RM using containers :[] 2019-08-07 10:42:50,944 INFO [main] security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(143)) - Rolling master-key for container-tokens, got key with id 123 2019-08-07 10:42:50,945 INFO [main] security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(143)) - Rolling master-key for container-tokens, got key with id 123 2019-08-07 10:42:50,945 INFO [main] nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(484)) - Registered with ResourceManager as null with total resource of 2019-08-07 10:42:50,945 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(226)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.event.EventHandler$MockitoMock$1934197612 2019-08-07 10:42:50,946 INFO [Time-limited test] logaggregation.LogAggregationService (LogAggregationService.java:calculateRollingMonitorInterval(115)) - rollingMonitorInterval is set as -1. The log rolling monitoring interval is disabled. The logs will be aggregated after this application is finished. 2019-08-07 10:42:50,946 INFO [Time-limited test] logaggregation.LogAggregationService (LogAggregationService.java:serviceInit(159)) - rollingMonitorInterval is set as -1. The logs will be aggregated every -1 seconds 2019-08-07 10:42:50,954 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(650)) - Deleting absolute path : /Users/adamantal/git/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestLogAggregationService-localDir 2019-08-07 10:42:50,961 INFO [main] nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(650)) - Deleting absolute path : /Users/adamantal/git/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.TestLogAggregationService-remoteLogDir java.lang.AssertionError: Expected :3 Actual :2 at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failNotEquals(Assert.java:834) at org.junit.Assert.assertEquals(Assert.java:645) at org.junit.Assert.assertEquals(Assert.java:631) at org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.TestLogAggregationService.testFixedSizeThreadPool(TestLogAggregationService.java:1249) at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748)