2016-08-15 19:08:38,078 INFO [main] capacity.TestCapacityScheduler (TestCapacityScheduler.java:setupQueueConfiguration(419)) - Setup top-level queues a and b 2016-08-15 19:08:38,192 INFO [main] conf.Configuration (Configuration.java:getConfResourceAsInputStream(2437)) - found resource core-site.xml at file:/opt/hadooptrunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/target/test-classes/core-site.xml 2016-08-15 19:08:38,262 WARN [main] util.NativeCodeLoader (NativeCodeLoader.java:(60)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2016-08-15 19:08:38,313 INFO [main] security.Groups (Groups.java:refresh(400)) - clearing userToGroupsMap cache 2016-08-15 19:08:38,432 INFO [main] conf.Configuration (Configuration.java:getConfResourceAsInputStream(2437)) - found resource yarn-site.xml at file:/opt/hadooptrunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/target/test-classes/yarn-site.xml 2016-08-15 19:08:38,702 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(212)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher 2016-08-15 19:08:38,960 INFO [main] security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:(75)) - NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms 2016-08-15 19:08:38,965 INFO [main] security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:(78)) - ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms 2016-08-15 19:08:38,971 INFO [main] security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:(94)) - AMRMTokenKeyRollingInterval: 86400000ms and AMRMTokenKeyActivationDelay: 900000 ms 2016-08-15 19:08:38,998 INFO [main] security.YarnAuthorizationProvider (YarnAuthorizationProvider.java:getInstance(57)) - org.apache.hadoop.yarn.security.ConfiguredYarnAuthorizer is instiantiated. 2016-08-15 19:08:39,027 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(212)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler 2016-08-15 19:08:39,030 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(212)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager 2016-08-15 19:08:39,031 INFO [main] resourcemanager.ResourceManager (ResourceManager.java:createScheduler(396)) - Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler 2016-08-15 19:08:39,055 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(212)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.event.EventDispatcher 2016-08-15 19:08:39,056 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(212)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher 2016-08-15 19:08:39,058 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(212)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher 2016-08-15 19:08:39,062 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(212)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher 2016-08-15 19:08:39,127 WARN [main] impl.MetricsConfig (MetricsConfig.java:loadFirst(127)) - Cannot locate configuration: tried hadoop-metrics2-resourcemanager.properties,hadoop-metrics2.properties 2016-08-15 19:08:39,227 INFO [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:startTimer(375)) - Scheduled snapshot period at 10 second(s). 2016-08-15 19:08:39,227 INFO [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:start(192)) - ResourceManager metrics system started 2016-08-15 19:08:39,258 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(212)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager 2016-08-15 19:08:39,272 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(212)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher 2016-08-15 19:08:39,275 INFO [main] resourcemanager.RMNMInfo (RMNMInfo.java:(63)) - Registered RMNMInfo MBean 2016-08-15 19:08:39,277 INFO [main] util.HostsFileReader (HostsFileReader.java:refresh(160)) - Refreshing hosts (include/exclude) list 2016-08-15 19:08:39,286 INFO [main] conf.Configuration (Configuration.java:getConfResourceAsInputStream(2437)) - found resource capacity-scheduler.xml at file:/opt/hadooptrunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/target/test-classes/capacity-scheduler.xml 2016-08-15 19:08:39,378 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(692)) - max alloc mb per queue for root is undefined 2016-08-15 19:08:39,378 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(696)) - max alloc vcore per queue for root is undefined 2016-08-15 19:08:39,398 INFO [main] capacity.ParentQueue (ParentQueue.java:setupQueueConfigs(126)) - root, capacity=1.0, asboluteCapacity=1.0, maxCapacity=1.0, asboluteMaxCapacity=1.0, state=RUNNING, acls=SUBMIT_APP:*ADMINISTER_QUEUE:*, labels=*, , reservationsContinueLooking=true 2016-08-15 19:08:39,399 INFO [main] capacity.ParentQueue (ParentQueue.java:(105)) - Initialized parent-queue root name=root, fullname=root 2016-08-15 19:08:39,405 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(692)) - max alloc mb per queue for root.a is undefined 2016-08-15 19:08:39,405 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(696)) - max alloc vcore per queue for root.a is undefined 2016-08-15 19:08:39,406 INFO [main] capacity.ParentQueue (ParentQueue.java:setupQueueConfigs(126)) - a, capacity=0.105, asboluteCapacity=0.105, maxCapacity=1.0, asboluteMaxCapacity=1.0, state=RUNNING, acls=SUBMIT_APP: ADMINISTER_QUEUE: , labels=*, , reservationsContinueLooking=true 2016-08-15 19:08:39,407 INFO [main] capacity.ParentQueue (ParentQueue.java:(105)) - Initialized parent-queue a name=a, fullname=root.a 2016-08-15 19:08:39,426 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(692)) - max alloc mb per queue for root.a.a1 is undefined 2016-08-15 19:08:39,426 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(696)) - max alloc vcore per queue for root.a.a1 is undefined 2016-08-15 19:08:39,436 INFO [main] capacity.LeafQueue (LeafQueue.java:setupQueueConfigs(219)) - Initializing a1 capacity = 0.3 [= (float) configuredCapacity / 100 ] asboluteCapacity = 0.0315 [= parentAbsoluteCapacity * capacity ] maxCapacity = 1.0 [= configuredMaxCapacity ] absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ] userLimit = 100 [= configuredUserLimit ] userLimitFactor = 100.0 [= configuredUserLimitFactor ] maxApplications = 315 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)] maxApplicationsPerUser = 315 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ] usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)] absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory] maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ] minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ] maximumAllocation = [= configuredMaxAllocation ] numContainers = 0 [= currentNumContainers ] state = RUNNING [= configuredState ] acls = SUBMIT_APP: ADMINISTER_QUEUE: [= configuredAcls ] nodeLocalityDelay = 40 labels=*, reservationsContinueLooking = true preemptionDisabled = true defaultAppPriorityPerQueue = 0 2016-08-15 19:08:39,437 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(684)) - Initialized queue: a1: capacity=0.3, absoluteCapacity=0.0315, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0 2016-08-15 19:08:39,444 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(692)) - max alloc mb per queue for root.a.a2 is undefined 2016-08-15 19:08:39,445 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(696)) - max alloc vcore per queue for root.a.a2 is undefined 2016-08-15 19:08:39,447 INFO [main] capacity.LeafQueue (LeafQueue.java:setupQueueConfigs(219)) - Initializing a2 capacity = 0.7 [= (float) configuredCapacity / 100 ] asboluteCapacity = 0.0735 [= parentAbsoluteCapacity * capacity ] maxCapacity = 1.0 [= configuredMaxCapacity ] absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ] userLimit = 100 [= configuredUserLimit ] userLimitFactor = 100.0 [= configuredUserLimitFactor ] maxApplications = 735 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)] maxApplicationsPerUser = 735 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ] usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)] absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory] maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ] minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ] maximumAllocation = [= configuredMaxAllocation ] numContainers = 0 [= currentNumContainers ] state = RUNNING [= configuredState ] acls = SUBMIT_APP: ADMINISTER_QUEUE: [= configuredAcls ] nodeLocalityDelay = 40 labels=*, reservationsContinueLooking = true preemptionDisabled = true defaultAppPriorityPerQueue = 0 2016-08-15 19:08:39,448 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(684)) - Initialized queue: a2: capacity=0.7, absoluteCapacity=0.0735, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0 2016-08-15 19:08:39,449 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(684)) - Initialized queue: a: numChildQueue= 2, capacity=0.105, absoluteCapacity=0.105, usedResources=usedCapacity=0.0, numApps=0, numContainers=0 2016-08-15 19:08:39,455 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(692)) - max alloc mb per queue for root.b is undefined 2016-08-15 19:08:39,456 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(696)) - max alloc vcore per queue for root.b is undefined 2016-08-15 19:08:39,457 INFO [main] capacity.ParentQueue (ParentQueue.java:setupQueueConfigs(126)) - b, capacity=0.895, asboluteCapacity=0.895, maxCapacity=1.0, asboluteMaxCapacity=1.0, state=RUNNING, acls=SUBMIT_APP: ADMINISTER_QUEUE: , labels=*, , reservationsContinueLooking=true 2016-08-15 19:08:39,457 INFO [main] capacity.ParentQueue (ParentQueue.java:(105)) - Initialized parent-queue b name=b, fullname=root.b 2016-08-15 19:08:39,462 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(692)) - max alloc mb per queue for root.b.b1 is undefined 2016-08-15 19:08:39,463 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(696)) - max alloc vcore per queue for root.b.b1 is undefined 2016-08-15 19:08:39,465 INFO [main] capacity.LeafQueue (LeafQueue.java:setupQueueConfigs(219)) - Initializing b1 capacity = 0.792 [= (float) configuredCapacity / 100 ] asboluteCapacity = 0.70883995 [= parentAbsoluteCapacity * capacity ] maxCapacity = 1.0 [= configuredMaxCapacity ] absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ] userLimit = 100 [= configuredUserLimit ] userLimitFactor = 100.0 [= configuredUserLimitFactor ] maxApplications = 7088 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)] maxApplicationsPerUser = 7088 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ] usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)] absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory] maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ] minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ] maximumAllocation = [= configuredMaxAllocation ] numContainers = 0 [= currentNumContainers ] state = RUNNING [= configuredState ] acls = SUBMIT_APP: ADMINISTER_QUEUE: [= configuredAcls ] nodeLocalityDelay = 40 labels=*, reservationsContinueLooking = true preemptionDisabled = true defaultAppPriorityPerQueue = 0 2016-08-15 19:08:39,466 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(684)) - Initialized queue: b1: capacity=0.792, absoluteCapacity=0.70883995, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0 2016-08-15 19:08:39,471 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(692)) - max alloc mb per queue for root.b.b2 is undefined 2016-08-15 19:08:39,472 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(696)) - max alloc vcore per queue for root.b.b2 is undefined 2016-08-15 19:08:39,474 INFO [main] capacity.LeafQueue (LeafQueue.java:setupQueueConfigs(219)) - Initializing b2 capacity = 0.008 [= (float) configuredCapacity / 100 ] asboluteCapacity = 0.00716 [= parentAbsoluteCapacity * capacity ] maxCapacity = 1.0 [= configuredMaxCapacity ] absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ] userLimit = 100 [= configuredUserLimit ] userLimitFactor = 100.0 [= configuredUserLimitFactor ] maxApplications = 71 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)] maxApplicationsPerUser = 71 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ] usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)] absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory] maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ] minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ] maximumAllocation = [= configuredMaxAllocation ] numContainers = 0 [= currentNumContainers ] state = RUNNING [= configuredState ] acls = SUBMIT_APP: ADMINISTER_QUEUE: [= configuredAcls ] nodeLocalityDelay = 40 labels=*, reservationsContinueLooking = true preemptionDisabled = true defaultAppPriorityPerQueue = 0 2016-08-15 19:08:39,474 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(684)) - Initialized queue: b2: capacity=0.008, absoluteCapacity=0.00716, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0 2016-08-15 19:08:39,480 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(692)) - max alloc mb per queue for root.b.b3 is undefined 2016-08-15 19:08:39,480 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(696)) - max alloc vcore per queue for root.b.b3 is undefined 2016-08-15 19:08:39,482 INFO [main] capacity.LeafQueue (LeafQueue.java:setupQueueConfigs(219)) - Initializing b3 capacity = 0.2 [= (float) configuredCapacity / 100 ] asboluteCapacity = 0.179 [= parentAbsoluteCapacity * capacity ] maxCapacity = 1.0 [= configuredMaxCapacity ] absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ] userLimit = 100 [= configuredUserLimit ] userLimitFactor = 100.0 [= configuredUserLimitFactor ] maxApplications = 1790 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)] maxApplicationsPerUser = 1790 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ] usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)] absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory] maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ] minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ] maximumAllocation = [= configuredMaxAllocation ] numContainers = 0 [= currentNumContainers ] state = RUNNING [= configuredState ] acls = SUBMIT_APP: ADMINISTER_QUEUE: [= configuredAcls ] nodeLocalityDelay = 40 labels=*, reservationsContinueLooking = true preemptionDisabled = true defaultAppPriorityPerQueue = 0 2016-08-15 19:08:39,483 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(684)) - Initialized queue: b3: capacity=0.2, absoluteCapacity=0.179, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0 2016-08-15 19:08:39,484 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(684)) - Initialized queue: b: numChildQueue= 3, capacity=0.895, absoluteCapacity=0.895, usedResources=usedCapacity=0.0, numApps=0, numContainers=0 2016-08-15 19:08:39,484 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(684)) - Initialized queue: root: numChildQueue= 2, capacity=1.0, absoluteCapacity=1.0, usedResources=usedCapacity=0.0, numApps=0, numContainers=0 2016-08-15 19:08:39,486 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:initializeQueues(519)) - Initialized root queue root: numChildQueue= 2, capacity=1.0, absoluteCapacity=1.0, usedResources=usedCapacity=0.0, numApps=0, numContainers=0 2016-08-15 19:08:39,487 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:getUserGroupMappingPlacementRule(467)) - Initialized queue mappings, override: false 2016-08-15 19:08:39,490 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:initScheduler(328)) - Initialized CapacityScheduler with calculator=class org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator, minimumAllocation=<>, maximumAllocation=<>, asynchronousScheduling=false, asyncScheduleInterval=5ms 2016-08-15 19:08:39,497 INFO [main] conf.Configuration (Configuration.java:getConfResourceAsInputStream(2434)) - dynamic-resources.xml not found 2016-08-15 19:08:39,520 INFO [main] resourcemanager.ResourceManager (ResourceManager.java:createSystemMetricsPublisher(486)) - TimelineServicePublisher is not configured 2016-08-15 19:08:39,522 INFO [main] security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:rollMasterKey(106)) - Rolling master-key for container-tokens 2016-08-15 19:08:39,545 INFO [main] security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:rollMasterKey(95)) - Rolling master-key for nm-tokens 2016-08-15 19:08:39,871 INFO [main] capacity.TestCapacityScheduler (TestCapacityScheduler.java:setupQueueConfiguration(419)) - Setup top-level queues a and b 2016-08-15 19:08:39,928 INFO [main] conf.Configuration (Configuration.java:getConfResourceAsInputStream(2437)) - found resource core-site.xml at file:/opt/hadooptrunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/target/test-classes/core-site.xml 2016-08-15 19:08:39,986 INFO [main] security.Groups (Groups.java:refresh(400)) - clearing userToGroupsMap cache 2016-08-15 19:08:39,990 INFO [main] conf.Configuration (Configuration.java:getConfResourceAsInputStream(2437)) - found resource yarn-site.xml at file:/opt/hadooptrunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/target/test-classes/yarn-site.xml 2016-08-15 19:08:40,038 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(212)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher 2016-08-15 19:08:40,040 INFO [main] security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:(75)) - NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms 2016-08-15 19:08:40,041 INFO [main] security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:(78)) - ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms 2016-08-15 19:08:40,043 INFO [main] security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:(94)) - AMRMTokenKeyRollingInterval: 86400000ms and AMRMTokenKeyActivationDelay: 900000 ms 2016-08-15 19:08:40,045 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(212)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler 2016-08-15 19:08:40,045 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(212)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager 2016-08-15 19:08:40,045 INFO [main] resourcemanager.ResourceManager (ResourceManager.java:createScheduler(396)) - Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler 2016-08-15 19:08:40,046 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(212)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.event.EventDispatcher 2016-08-15 19:08:40,046 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(212)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher 2016-08-15 19:08:40,047 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(212)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher 2016-08-15 19:08:40,047 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(212)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher 2016-08-15 19:08:40,047 INFO [main] security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:rollMasterKey(106)) - Rolling master-key for container-tokens 2016-08-15 19:08:40,048 INFO [main] security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:rollMasterKey(95)) - Rolling master-key for nm-tokens 2016-08-15 19:08:40,049 WARN [main] impl.MetricsSystemImpl (MetricsSystemImpl.java:init(152)) - ResourceManager metrics system already initialized! 2016-08-15 19:08:40,050 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(212)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager 2016-08-15 19:08:40,050 INFO [main] event.AsyncDispatcher (AsyncDispatcher.java:register(212)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.MockRM$6 2016-08-15 19:08:40,052 WARN [main] util.MBeans (MBeans.java:getMBeanName(125)) - Error creating MBean object name: Hadoop:service=ResourceManager,name=RMNMInfo org.apache.hadoop.metrics2.MetricsException: org.apache.hadoop.metrics2.MetricsException: Hadoop:service=ResourceManager,name=RMNMInfo already exists! at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newObjectName(DefaultMetricsSystem.java:135) at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newMBeanName(DefaultMetricsSystem.java:110) at org.apache.hadoop.metrics2.util.MBeans.getMBeanName(MBeans.java:123) at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:64) at org.apache.hadoop.yarn.server.resourcemanager.RMNMInfo.(RMNMInfo.java:59) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:692) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:1037) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:294) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.yarn.server.resourcemanager.MockRM.(MockRM.java:135) at org.apache.hadoop.yarn.server.resourcemanager.MockRM.(MockRM.java:128) at org.apache.hadoop.yarn.server.resourcemanager.MockRM.(MockRM.java:124) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler.setUpMove(TestCapacityScheduler.java:1376) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler.setUpMove(TestCapacityScheduler.java:1367) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler.testKillAllAppsInQueue(TestCapacityScheduler.java:2156) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:254) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:149) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) Caused by: org.apache.hadoop.metrics2.MetricsException: Hadoop:service=ResourceManager,name=RMNMInfo already exists! at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newObjectName(DefaultMetricsSystem.java:131) ... 40 more 2016-08-15 19:08:40,058 INFO [main] resourcemanager.RMNMInfo (RMNMInfo.java:(63)) - Registered RMNMInfo MBean 2016-08-15 19:08:40,059 INFO [main] util.HostsFileReader (HostsFileReader.java:refresh(160)) - Refreshing hosts (include/exclude) list 2016-08-15 19:08:40,061 INFO [main] conf.Configuration (Configuration.java:getConfResourceAsInputStream(2437)) - found resource capacity-scheduler.xml at file:/opt/hadooptrunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/target/test-classes/capacity-scheduler.xml 2016-08-15 19:08:40,109 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(692)) - max alloc mb per queue for root is undefined 2016-08-15 19:08:40,110 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(696)) - max alloc vcore per queue for root is undefined 2016-08-15 19:08:40,111 INFO [main] capacity.ParentQueue (ParentQueue.java:setupQueueConfigs(126)) - root, capacity=1.0, asboluteCapacity=1.0, maxCapacity=1.0, asboluteMaxCapacity=1.0, state=RUNNING, acls=SUBMIT_APP:*ADMINISTER_QUEUE:*, labels=*, , reservationsContinueLooking=true 2016-08-15 19:08:40,112 INFO [main] capacity.ParentQueue (ParentQueue.java:(105)) - Initialized parent-queue root name=root, fullname=root 2016-08-15 19:08:40,114 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(692)) - max alloc mb per queue for root.a is undefined 2016-08-15 19:08:40,115 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(696)) - max alloc vcore per queue for root.a is undefined 2016-08-15 19:08:40,116 INFO [main] capacity.ParentQueue (ParentQueue.java:setupQueueConfigs(126)) - a, capacity=0.105, asboluteCapacity=0.105, maxCapacity=1.0, asboluteMaxCapacity=1.0, state=RUNNING, acls=SUBMIT_APP: ADMINISTER_QUEUE: , labels=*, , reservationsContinueLooking=true 2016-08-15 19:08:40,116 INFO [main] capacity.ParentQueue (ParentQueue.java:(105)) - Initialized parent-queue a name=a, fullname=root.a 2016-08-15 19:08:40,119 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(692)) - max alloc mb per queue for root.a.a1 is undefined 2016-08-15 19:08:40,119 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(696)) - max alloc vcore per queue for root.a.a1 is undefined 2016-08-15 19:08:40,121 INFO [main] capacity.LeafQueue (LeafQueue.java:setupQueueConfigs(219)) - Initializing a1 capacity = 0.3 [= (float) configuredCapacity / 100 ] asboluteCapacity = 0.0315 [= parentAbsoluteCapacity * capacity ] maxCapacity = 1.0 [= configuredMaxCapacity ] absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ] userLimit = 100 [= configuredUserLimit ] userLimitFactor = 100.0 [= configuredUserLimitFactor ] maxApplications = 315 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)] maxApplicationsPerUser = 315 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ] usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)] absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory] maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ] minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ] maximumAllocation = [= configuredMaxAllocation ] numContainers = 0 [= currentNumContainers ] state = RUNNING [= configuredState ] acls = SUBMIT_APP: ADMINISTER_QUEUE: [= configuredAcls ] nodeLocalityDelay = 40 labels=*, reservationsContinueLooking = true preemptionDisabled = true defaultAppPriorityPerQueue = 0 2016-08-15 19:08:40,122 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(684)) - Initialized queue: a1: capacity=0.3, absoluteCapacity=0.0315, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0 2016-08-15 19:08:40,124 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(692)) - max alloc mb per queue for root.a.a2 is undefined 2016-08-15 19:08:40,125 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(696)) - max alloc vcore per queue for root.a.a2 is undefined 2016-08-15 19:08:40,127 INFO [main] capacity.LeafQueue (LeafQueue.java:setupQueueConfigs(219)) - Initializing a2 capacity = 0.7 [= (float) configuredCapacity / 100 ] asboluteCapacity = 0.0735 [= parentAbsoluteCapacity * capacity ] maxCapacity = 1.0 [= configuredMaxCapacity ] absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ] userLimit = 100 [= configuredUserLimit ] userLimitFactor = 100.0 [= configuredUserLimitFactor ] maxApplications = 735 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)] maxApplicationsPerUser = 735 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ] usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)] absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory] maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ] minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ] maximumAllocation = [= configuredMaxAllocation ] numContainers = 0 [= currentNumContainers ] state = RUNNING [= configuredState ] acls = SUBMIT_APP: ADMINISTER_QUEUE: [= configuredAcls ] nodeLocalityDelay = 40 labels=*, reservationsContinueLooking = true preemptionDisabled = true defaultAppPriorityPerQueue = 0 2016-08-15 19:08:40,128 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(684)) - Initialized queue: a2: capacity=0.7, absoluteCapacity=0.0735, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0 2016-08-15 19:08:40,128 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(684)) - Initialized queue: a: numChildQueue= 2, capacity=0.105, absoluteCapacity=0.105, usedResources=usedCapacity=0.0, numApps=0, numContainers=0 2016-08-15 19:08:40,131 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(692)) - max alloc mb per queue for root.b is undefined 2016-08-15 19:08:40,131 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(696)) - max alloc vcore per queue for root.b is undefined 2016-08-15 19:08:40,132 INFO [main] capacity.ParentQueue (ParentQueue.java:setupQueueConfigs(126)) - b, capacity=0.895, asboluteCapacity=0.895, maxCapacity=1.0, asboluteMaxCapacity=1.0, state=RUNNING, acls=SUBMIT_APP: ADMINISTER_QUEUE: , labels=*, , reservationsContinueLooking=true 2016-08-15 19:08:40,133 INFO [main] capacity.ParentQueue (ParentQueue.java:(105)) - Initialized parent-queue b name=b, fullname=root.b 2016-08-15 19:08:40,135 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(692)) - max alloc mb per queue for root.b.b1 is undefined 2016-08-15 19:08:40,136 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(696)) - max alloc vcore per queue for root.b.b1 is undefined 2016-08-15 19:08:40,138 INFO [main] capacity.LeafQueue (LeafQueue.java:setupQueueConfigs(219)) - Initializing b1 capacity = 0.792 [= (float) configuredCapacity / 100 ] asboluteCapacity = 0.70883995 [= parentAbsoluteCapacity * capacity ] maxCapacity = 1.0 [= configuredMaxCapacity ] absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ] userLimit = 100 [= configuredUserLimit ] userLimitFactor = 100.0 [= configuredUserLimitFactor ] maxApplications = 7088 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)] maxApplicationsPerUser = 7088 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ] usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)] absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory] maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ] minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ] maximumAllocation = [= configuredMaxAllocation ] numContainers = 0 [= currentNumContainers ] state = RUNNING [= configuredState ] acls = SUBMIT_APP: ADMINISTER_QUEUE: [= configuredAcls ] nodeLocalityDelay = 40 labels=*, reservationsContinueLooking = true preemptionDisabled = true defaultAppPriorityPerQueue = 0 2016-08-15 19:08:40,139 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(684)) - Initialized queue: b1: capacity=0.792, absoluteCapacity=0.70883995, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0 2016-08-15 19:08:40,142 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(692)) - max alloc mb per queue for root.b.b2 is undefined 2016-08-15 19:08:40,143 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(696)) - max alloc vcore per queue for root.b.b2 is undefined 2016-08-15 19:08:40,145 INFO [main] capacity.LeafQueue (LeafQueue.java:setupQueueConfigs(219)) - Initializing b2 capacity = 0.008 [= (float) configuredCapacity / 100 ] asboluteCapacity = 0.00716 [= parentAbsoluteCapacity * capacity ] maxCapacity = 1.0 [= configuredMaxCapacity ] absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ] userLimit = 100 [= configuredUserLimit ] userLimitFactor = 100.0 [= configuredUserLimitFactor ] maxApplications = 71 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)] maxApplicationsPerUser = 71 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ] usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)] absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory] maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ] minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ] maximumAllocation = [= configuredMaxAllocation ] numContainers = 0 [= currentNumContainers ] state = RUNNING [= configuredState ] acls = SUBMIT_APP: ADMINISTER_QUEUE: [= configuredAcls ] nodeLocalityDelay = 40 labels=*, reservationsContinueLooking = true preemptionDisabled = true defaultAppPriorityPerQueue = 0 2016-08-15 19:08:40,146 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(684)) - Initialized queue: b2: capacity=0.008, absoluteCapacity=0.00716, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0 2016-08-15 19:08:40,148 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(692)) - max alloc mb per queue for root.b.b3 is undefined 2016-08-15 19:08:40,148 INFO [main] capacity.CapacitySchedulerConfiguration (CapacitySchedulerConfiguration.java:getMaximumAllocationPerQueue(696)) - max alloc vcore per queue for root.b.b3 is undefined 2016-08-15 19:08:40,151 INFO [main] capacity.LeafQueue (LeafQueue.java:setupQueueConfigs(219)) - Initializing b3 capacity = 0.2 [= (float) configuredCapacity / 100 ] asboluteCapacity = 0.179 [= parentAbsoluteCapacity * capacity ] maxCapacity = 1.0 [= configuredMaxCapacity ] absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ] userLimit = 100 [= configuredUserLimit ] userLimitFactor = 100.0 [= configuredUserLimitFactor ] maxApplications = 1790 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)] maxApplicationsPerUser = 1790 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ] usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)] absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory] maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ] minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ] maximumAllocation = [= configuredMaxAllocation ] numContainers = 0 [= currentNumContainers ] state = RUNNING [= configuredState ] acls = SUBMIT_APP: ADMINISTER_QUEUE: [= configuredAcls ] nodeLocalityDelay = 40 labels=*, reservationsContinueLooking = true preemptionDisabled = true defaultAppPriorityPerQueue = 0 2016-08-15 19:08:40,151 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(684)) - Initialized queue: b3: capacity=0.2, absoluteCapacity=0.179, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0 2016-08-15 19:08:40,152 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(684)) - Initialized queue: b: numChildQueue= 3, capacity=0.895, absoluteCapacity=0.895, usedResources=usedCapacity=0.0, numApps=0, numContainers=0 2016-08-15 19:08:40,153 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(684)) - Initialized queue: root: numChildQueue= 2, capacity=1.0, absoluteCapacity=1.0, usedResources=usedCapacity=0.0, numApps=0, numContainers=0 2016-08-15 19:08:40,153 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:initializeQueues(519)) - Initialized root queue root: numChildQueue= 2, capacity=1.0, absoluteCapacity=1.0, usedResources=usedCapacity=0.0, numApps=0, numContainers=0 2016-08-15 19:08:40,154 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:getUserGroupMappingPlacementRule(467)) - Initialized queue mappings, override: false 2016-08-15 19:08:40,155 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:initScheduler(328)) - Initialized CapacityScheduler with calculator=class org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator, minimumAllocation=<>, maximumAllocation=<>, asynchronousScheduling=false, asyncScheduleInterval=5ms 2016-08-15 19:08:40,156 INFO [main] conf.Configuration (Configuration.java:getConfResourceAsInputStream(2434)) - dynamic-resources.xml not found 2016-08-15 19:08:40,160 INFO [main] resourcemanager.ResourceManager (ResourceManager.java:createSystemMetricsPublisher(486)) - TimelineServicePublisher is not configured 2016-08-15 19:08:40,161 INFO [main] resourcemanager.ResourceManager (ResourceManager.java:transitionToActive(1081)) - Transitioning to active state 2016-08-15 19:08:40,164 DEBUG [main] security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1817)) - PrivilegedAction as:root (auth:SIMPLE) from:org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.transitionToActive(ResourceManager.java:1083) 2016-08-15 19:08:40,181 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service Dispatcher is started 2016-08-15 19:08:40,182 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore is started 2016-08-15 19:08:40,183 DEBUG [main] service.CompositeService (CompositeService.java:serviceStart(115)) - RMActiveServices: starting services, size=14 2016-08-15 19:08:40,192 DEBUG [main] recovery.RMStateStore (RMStateStore.java:handleStoreEvent(1070)) - Processing event of type UPDATE_AMRM_TOKEN 2016-08-15 19:08:40,193 INFO [main] recovery.RMStateStore (RMStateStore.java:transition(487)) - Updating AMRMToken 2016-08-15 19:08:40,194 INFO [main] security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:rollMasterKey(106)) - Rolling master-key for container-tokens 2016-08-15 19:08:40,195 INFO [main] security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:rollMasterKey(111)) - Going to activate master-key with key-id 375402738 in 900000ms 2016-08-15 19:08:40,196 INFO [main] security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:rollMasterKey(95)) - Rolling master-key for nm-tokens 2016-08-15 19:08:40,197 INFO [main] security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:rollMasterKey(100)) - Going to activate master-key with key-id 1858264348 in 900000ms 2016-08-15 19:08:40,198 INFO [main] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(336)) - Updating the current master key for generating delegation tokens 2016-08-15 19:08:40,199 INFO [main] security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(87)) - storing master key with keyID 1 2016-08-15 19:08:40,200 DEBUG [main] recovery.RMStateStore (RMStateStore.java:handleStoreEvent(1070)) - Processing event of type STORE_MASTERKEY 2016-08-15 19:08:40,211 INFO [main] recovery.RMStateStore (RMStateStore.java:transition(438)) - Storing RMDTMasterKey. 2016-08-15 19:08:40,221 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service org.apache.hadoop.yarn.server.resourcemanager.RMSecretManagerService is started 2016-08-15 19:08:40,222 INFO [Thread[Thread-18,5,main]] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(649)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s) 2016-08-15 19:08:40,223 INFO [Thread[Thread-18,5,main]] delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(336)) - Updating the current master key for generating delegation tokens 2016-08-15 19:08:40,223 INFO [Thread[Thread-18,5,main]] security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(87)) - storing master key with keyID 2 2016-08-15 19:08:40,223 DEBUG [Thread[Thread-18,5,main]] recovery.RMStateStore (RMStateStore.java:handleStoreEvent(1070)) - Processing event of type STORE_MASTERKEY 2016-08-15 19:08:40,223 INFO [Thread[Thread-18,5,main]] recovery.RMStateStore (RMStateStore.java:transition(438)) - Storing RMDTMasterKey. 2016-08-15 19:08:40,224 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer is started 2016-08-15 19:08:40,224 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service AMLivelinessMonitor is started 2016-08-15 19:08:40,225 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service AMLivelinessMonitor is started 2016-08-15 19:08:40,225 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service org.apache.hadoop.yarn.nodelabels.CommonNodeLabelsManager is started 2016-08-15 19:08:40,226 DEBUG [main] service.CompositeService (CompositeService.java:serviceStart(115)) - org.apache.hadoop.yarn.server.resourcemanager.NodesListManager: starting services, size=0 2016-08-15 19:08:40,226 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service org.apache.hadoop.yarn.server.resourcemanager.NodesListManager is started 2016-08-15 19:08:40,227 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service org.apache.hadoop.yarn.server.resourcemanager.scheduler.activities.ActivitiesManager is started 2016-08-15 19:08:40,228 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler is started 2016-08-15 19:08:40,228 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service SchedulerEventDispatcher is started 2016-08-15 19:08:40,229 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service NMLivelinessMonitor is started 2016-08-15 19:08:40,229 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService is started 2016-08-15 19:08:40,231 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service org.apache.hadoop.util.JvmPauseMonitor is started 2016-08-15 19:08:40,231 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService is started 2016-08-15 19:08:40,232 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service org.apache.hadoop.yarn.server.resourcemanager.ClientRMService is started 2016-08-15 19:08:40,232 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher is started 2016-08-15 19:08:40,232 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service RMActiveServices is started 2016-08-15 19:08:40,232 INFO [main] resourcemanager.ResourceManager (ResourceManager.java:transitionToActive(1097)) - Transitioned to active state 2016-08-15 19:08:40,233 INFO [org.apache.hadoop.util.JvmPauseMonitor$Monitor@1f53a5dc] util.JvmPauseMonitor (JvmPauseMonitor.java:run(188)) - Starting JVM pause monitor 2016-08-15 19:08:40,233 DEBUG [main] service.CompositeService (CompositeService.java:serviceStart(115)) - ResourceManager: starting services, size=3 2016-08-15 19:08:40,234 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service Dispatcher is started 2016-08-15 19:08:40,234 DEBUG [main] service.CompositeService (CompositeService.java:serviceStart(115)) - org.apache.hadoop.yarn.server.resourcemanager.AdminService: starting services, size=0 2016-08-15 19:08:40,235 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service org.apache.hadoop.yarn.server.resourcemanager.AdminService is started 2016-08-15 19:08:40,235 DEBUG [main] service.CompositeService (CompositeService.java:serviceStart(115)) - org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter: starting services, size=0 2016-08-15 19:08:40,235 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter is started 2016-08-15 19:08:40,235 DEBUG [main] service.AbstractService (AbstractService.java:start(197)) - Service ResourceManager is started 2016-08-15 19:08:40,251 INFO [main] resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(319)) - Allocated new applicationId: 1 2016-08-15 19:08:40,331 DEBUG [main] util.PerformanceAdvisory (JniBasedUnixGroupsMappingWithFallback.java:(41)) - Falling back to shell based 2016-08-15 19:08:40,332 DEBUG [main] security.JniBasedUnixGroupsMappingWithFallback (JniBasedUnixGroupsMappingWithFallback.java:(45)) - Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping 2016-08-15 19:08:40,333 DEBUG [main] security.Groups (Groups.java:(150)) - Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000; warningDeltaMs=5000 2016-08-15 19:08:40,334 DEBUG [main] security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1817)) - PrivilegedAction as:user_0 (auth:SIMPLE) from:org.apache.hadoop.yarn.server.resourcemanager.MockRM.submitApp(MockRM.java:647) 2016-08-15 19:08:40,379 INFO [main] capacity.CapacityScheduler (CapacityScheduler.java:checkAndGetApplicationPriority(2082)) - Priority '0' is acceptable in queue : a1 for application: application_1471268320166_0001 for the user: user_0 2016-08-15 19:08:40,417 INFO [main] resourcemanager.ClientRMService (ClientRMService.java:submitApplication(646)) - Application with id 1 submitted by user user_0 2016-08-15 19:08:40,417 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(178)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEvent.EventType: START 2016-08-15 19:08:40,419 DEBUG [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:handle(864)) - Processing event for application_1471268320166_0001 of type START 2016-08-15 19:08:40,420 INFO [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:transition(1216)) - Storing application with id application_1471268320166_0001 2016-08-15 19:08:40,426 INFO [main] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(188)) - USER=user_0 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1471268320166_0001 2016-08-15 19:08:40,438 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(178)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreAppEvent.EventType: STORE_APP 2016-08-15 19:08:40,439 DEBUG [AsyncDispatcher event handler] recovery.RMStateStore (RMStateStore.java:handleStoreEvent(1070)) - Processing event of type STORE_APP 2016-08-15 19:08:40,439 INFO [AsyncDispatcher event handler] recovery.RMStateStore (RMStateStore.java:transition(213)) - Storing info for app: application_1471268320166_0001 2016-08-15 19:08:40,438 INFO [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:handle(876)) - application_1471268320166_0001 State change from NEW to NEW_SAVING on event=START 2016-08-15 19:08:40,441 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(178)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEvent.EventType: APP_NEW_SAVED 2016-08-15 19:08:40,442 DEBUG [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:handle(864)) - Processing event for application_1471268320166_0001 of type APP_NEW_SAVED 2016-08-15 19:08:40,443 INFO [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:handle(876)) - application_1471268320166_0001 State change from NEW_SAVING to SUBMITTED on event=APP_NEW_SAVED 2016-08-15 19:08:40,443 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(178)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.AppAddedSchedulerEvent.EventType: APP_ADDED 2016-08-15 19:08:40,444 INFO [main] resourcemanager.MockRM (MockRM.java:waitForState(188)) - App : application_1471268320166_0001 State is : SUBMITTED Waiting for state : ACCEPTED 2016-08-15 19:08:40,446 INFO [SchedulerEventDispatcher:Event Processor] capacity.ParentQueue (ParentQueue.java:addApplication(350)) - Application added - appId: application_1471268320166_0001 user: user_0 leaf-queue of parent: a #applications: 1 2016-08-15 19:08:40,447 INFO [SchedulerEventDispatcher:Event Processor] capacity.ParentQueue (ParentQueue.java:addApplication(350)) - Application added - appId: application_1471268320166_0001 user: user_0 leaf-queue of parent: root #applications: 1 2016-08-15 19:08:40,448 INFO [SchedulerEventDispatcher:Event Processor] capacity.CapacityScheduler (CapacityScheduler.java:addApplication(792)) - Accepted application application_1471268320166_0001 from user: user_0, in queue: a1 2016-08-15 19:08:40,448 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(178)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEvent.EventType: APP_ACCEPTED 2016-08-15 19:08:40,448 DEBUG [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:handle(864)) - Processing event for application_1471268320166_0001 of type APP_ACCEPTED 2016-08-15 19:08:40,496 INFO [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:handle(876)) - application_1471268320166_0001 State change from SUBMITTED to ACCEPTED on event=APP_ACCEPTED 2016-08-15 19:08:40,496 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(178)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppStartAttemptEvent.EventType: START 2016-08-15 19:08:40,496 INFO [main] resourcemanager.MockRM (MockRM.java:waitForState(194)) - App State is : ACCEPTED 2016-08-15 19:08:40,496 DEBUG [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(859)) - Processing event for appattempt_1471268320166_0001_000001 of type START 2016-08-15 19:08:40,529 INFO [AsyncDispatcher event handler] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(685)) - Registering app attempt : appattempt_1471268320166_0001_000001 2016-08-15 19:08:40,530 INFO [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(871)) - appattempt_1471268320166_0001_000001 State change from NEW to SUBMITTED 2016-08-15 19:08:40,530 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(178)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.AppAttemptAddedSchedulerEvent.EventType: APP_ATTEMPT_ADDED 2016-08-15 19:08:40,531 INFO [main] resourcemanager.MockRM (MockRM.java:waitForState(261)) - AppAttempt : appattempt_1471268320166_0001_000001 State is : SUBMITTED Waiting for state : SCHEDULED 2016-08-15 19:08:40,541 INFO [main] resourcemanager.MockRM (MockRM.java:waitForState(261)) - AppAttempt : appattempt_1471268320166_0001_000001 State is : SUBMITTED Waiting for state : SCHEDULED 2016-08-15 19:08:40,552 INFO [main] resourcemanager.MockRM (MockRM.java:waitForState(261)) - AppAttempt : appattempt_1471268320166_0001_000001 State is : SUBMITTED Waiting for state : SCHEDULED 2016-08-15 19:08:40,562 INFO [main] resourcemanager.MockRM (MockRM.java:waitForState(261)) - AppAttempt : appattempt_1471268320166_0001_000001 State is : SUBMITTED Waiting for state : SCHEDULED 2016-08-15 19:08:40,564 DEBUG [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue (LeafQueue.java:activateApplications(648)) - application application_1471268320166_0001 AMResource maxAMResourcePerQueuePercent 0.1 amLimit lastClusterResource amIfStarted AM node-partition name 2016-08-15 19:08:40,564 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue (LeafQueue.java:activateApplications(662)) - maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2016-08-15 19:08:40,564 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue (LeafQueue.java:activateApplications(696)) - maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2016-08-15 19:08:40,567 INFO [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue (LeafQueue.java:activateApplications(722)) - Application application_1471268320166_0001 from user: user_0 activated in queue: a1 2016-08-15 19:08:40,567 INFO [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue (LeafQueue.java:addApplicationAttempt(737)) - Application added - appId: application_1471268320166_0001 user: user_0, leaf-queue: a1 #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1 2016-08-15 19:08:40,567 INFO [SchedulerEventDispatcher:Event Processor] capacity.CapacityScheduler (CapacityScheduler.java:addApplicationAttempt(832)) - Added Application Attempt appattempt_1471268320166_0001_000001 to scheduler from user user_0 in queue a1 2016-08-15 19:08:40,568 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(178)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEvent.EventType: ATTEMPT_ADDED 2016-08-15 19:08:40,568 DEBUG [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(859)) - Processing event for appattempt_1471268320166_0001_000001 of type ATTEMPT_ADDED 2016-08-15 19:08:40,568 WARN [AsyncDispatcher event handler] blacklist.SimpleBlacklistManager (SimpleBlacklistManager.java:getBlacklistUpdates(76)) - Ignoring Blacklists, blacklist size 0 is more than failure threshold ratio 0.800000011920929 out of total usable nodes 0 2016-08-15 19:08:40,662 DEBUG [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:transition(1040)) - Using blacklist for AM: additions([]) and removals([]) 2016-08-15 19:08:40,663 DEBUG [AsyncDispatcher event handler] capacity.CapacityScheduler (CapacityScheduler.java:allocate(991)) - allocate: pre-update appattempt_1471268320166_0001_000001 ask size =1 2016-08-15 19:08:40,664 DEBUG [AsyncDispatcher event handler] scheduler.ActiveUsersManager (ActiveUsersManager.java:activateApplication(68)) - User user_0 added to activeUsers, currently: 1 2016-08-15 19:08:40,664 DEBUG [AsyncDispatcher event handler] capacity.CapacityScheduler (CapacityScheduler.java:allocate(1003)) - allocate: post-update 2016-08-15 19:08:40,665 DEBUG [AsyncDispatcher event handler] scheduler.SchedulerApplicationAttempt (SchedulerApplicationAttempt.java:showRequests(514)) - showRequests: application=application_1471268320166_0001 headRoom= currentConsumption=0 2016-08-15 19:08:40,665 DEBUG [AsyncDispatcher event handler] scheduler.SchedulerApplicationAttempt (SchedulerApplicationAttempt.java:showRequests(518)) - showRequests: application=application_1471268320166_0001 request={AllocationRequestId: 0, Priority: 0, Capability: , # Containers: 1, Location: *, Relax Locality: true, Execution Type Request: {Execution Type: GUARANTEED, Enforce Execution Type: false}, Node Label Expression: } 2016-08-15 19:08:40,666 INFO [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(871)) - appattempt_1471268320166_0001_000001 State change from SUBMITTED to SCHEDULED 2016-08-15 19:08:40,666 INFO [main] resourcemanager.MockRM (MockRM.java:waitForState(267)) - Attempt State is : SCHEDULED 2016-08-15 19:08:40,675 DEBUG [main] security.ApplicationACLsManager (ApplicationACLsManager.java:checkAccess(102)) - Verifying access-type VIEW_APP for root (auth:SIMPLE) on application application_1471268320166_0001 owned by user_0 2016-08-15 19:08:40,711 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(178)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEvent.EventType: KILL 2016-08-15 19:08:40,711 INFO [main] resourcemanager.MockRM (MockRM.java:waitForState(188)) - App : application_1471268320166_0001 State is : ACCEPTED Waiting for state : KILLED 2016-08-15 19:08:40,712 DEBUG [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:handle(864)) - Processing event for application_1471268320166_0001 of type KILL 2016-08-15 19:08:40,713 INFO [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:handle(876)) - application_1471268320166_0001 State change from ACCEPTED to KILLING on event=KILL 2016-08-15 19:08:40,713 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(178)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEvent.EventType: KILL 2016-08-15 19:08:40,713 DEBUG [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(859)) - Processing event for appattempt_1471268320166_0001_000001 of type KILL 2016-08-15 19:08:40,722 INFO [main] resourcemanager.MockRM (MockRM.java:waitForState(188)) - App : application_1471268320166_0001 State is : KILLING Waiting for state : KILLED 2016-08-15 19:08:40,733 INFO [main] resourcemanager.MockRM (MockRM.java:waitForState(188)) - App : application_1471268320166_0001 State is : KILLING Waiting for state : KILLED 2016-08-15 19:08:40,743 INFO [main] resourcemanager.MockRM (MockRM.java:waitForState(188)) - App : application_1471268320166_0001 State is : KILLING Waiting for state : KILLED 2016-08-15 19:08:40,745 INFO [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:rememberTargetTransitionsAndStoreState(1300)) - Updating application attempt appattempt_1471268320166_0001_000001 with final state: KILLED, and exit status: -1000 2016-08-15 19:08:40,746 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(178)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateUpdateAppAttemptEvent.EventType: UPDATE_APP_ATTEMPT 2016-08-15 19:08:40,746 INFO [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(871)) - appattempt_1471268320166_0001_000001 State change from SCHEDULED to FINAL_SAVING 2016-08-15 19:08:40,746 DEBUG [AsyncDispatcher event handler] recovery.RMStateStore (RMStateStore.java:handleStoreEvent(1070)) - Processing event of type UPDATE_APP_ATTEMPT 2016-08-15 19:08:40,747 DEBUG [AsyncDispatcher event handler] recovery.RMStateStore (RMStateStore.java:transition(331)) - Updating info for attempt: appattempt_1471268320166_0001_000001 2016-08-15 19:08:40,747 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(178)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEvent.EventType: ATTEMPT_UPDATE_SAVED 2016-08-15 19:08:40,747 DEBUG [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(859)) - Processing event for appattempt_1471268320166_0001_000001 of type ATTEMPT_UPDATE_SAVED 2016-08-15 19:08:40,747 INFO [AsyncDispatcher event handler] resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(691)) - Unregistering app attempt : appattempt_1471268320166_0001_000001 2016-08-15 19:08:40,748 INFO [AsyncDispatcher event handler] security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:applicationMasterFinished(124)) - Application finished, removing password for appattempt_1471268320166_0001_000001 2016-08-15 19:08:40,749 INFO [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(871)) - appattempt_1471268320166_0001_000001 State change from FINAL_SAVING to KILLED 2016-08-15 19:08:40,749 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(178)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppFailedAttemptEvent.EventType: ATTEMPT_KILLED 2016-08-15 19:08:40,749 DEBUG [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:handle(864)) - Processing event for application_1471268320166_0001 of type ATTEMPT_KILLED 2016-08-15 19:08:40,750 INFO [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:rememberTargetTransitionsAndStoreState(1235)) - Updating application application_1471268320166_0001 with final state: KILLED 2016-08-15 19:08:40,750 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(178)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateUpdateAppEvent.EventType: UPDATE_APP 2016-08-15 19:08:40,751 DEBUG [AsyncDispatcher event handler] recovery.RMStateStore (RMStateStore.java:handleStoreEvent(1070)) - Processing event of type UPDATE_APP 2016-08-15 19:08:40,751 INFO [AsyncDispatcher event handler] recovery.RMStateStore (RMStateStore.java:transition(242)) - Updating info for app: application_1471268320166_0001 2016-08-15 19:08:40,751 INFO [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:handle(876)) - application_1471268320166_0001 State change from KILLING to FINAL_SAVING on event=ATTEMPT_KILLED 2016-08-15 19:08:40,752 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(178)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.AppAttemptRemovedSchedulerEvent.EventType: APP_ATTEMPT_REMOVED 2016-08-15 19:08:40,752 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(178)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEvent.EventType: APP_UPDATE_SAVED 2016-08-15 19:08:40,752 DEBUG [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:handle(864)) - Processing event for application_1471268320166_0001 of type APP_UPDATE_SAVED 2016-08-15 19:08:40,752 INFO [SchedulerEventDispatcher:Event Processor] capacity.CapacityScheduler (CapacityScheduler.java:doneApplicationAttempt(871)) - Application Attempt appattempt_1471268320166_0001_000001 is done. finalState=KILLED 2016-08-15 19:08:40,755 INFO [AsyncDispatcher event handler] rmapp.RMAppImpl (RMAppImpl.java:handle(876)) - application_1471268320166_0001 State change from FINAL_SAVING to KILLED on event=APP_UPDATE_SAVED 2016-08-15 19:08:40,755 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(178)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.AppRemovedSchedulerEvent.EventType: APP_REMOVED 2016-08-15 19:08:40,755 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(178)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEvent.EventType: APP_COMPLETED 2016-08-15 19:08:40,755 INFO [main] resourcemanager.MockRM (MockRM.java:waitForState(194)) - App State is : KILLED 2016-08-15 19:08:40,755 INFO [SchedulerEventDispatcher:Event Processor] scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(136)) - Application application_1471268320166_0001 requests cleared 2016-08-15 19:08:40,756 DEBUG [main] service.AbstractService (AbstractService.java:enterState(452)) - Service: ResourceManager entered state STOPPED 2016-08-15 19:08:40,755 DEBUG [AsyncDispatcher event handler] resourcemanager.RMAppManager (RMAppManager.java:handle(494)) - RMAppManager processing event for application_1471268320166_0001 of type APP_COMPLETED 2016-08-15 19:08:40,757 DEBUG [main] service.CompositeService (CompositeService.java:serviceStop(129)) - ResourceManager: stopping services, size=3 2016-08-15 19:08:40,756 INFO [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue (LeafQueue.java:removeApplicationAttempt(789)) - Application removed - appId: application_1471268320166_0001 user: user_0 queue: a1 #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-active-applications: 0 2016-08-15 19:08:40,758 DEBUG [SchedulerEventDispatcher:Event Processor] scheduler.ActiveUsersManager (ActiveUsersManager.java:deactivateApplication(94)) - User user_0 removed from activeUsers, currently: 0 2016-08-15 19:08:40,758 DEBUG [main] service.CompositeService (CompositeService.java:stop(151)) - Stopping service #2: Service org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter in state org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter: INITED 2016-08-15 19:08:40,759 INFO [AsyncDispatcher event handler] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(236)) - USER=user_0 OPERATION=Application Finished - Killed TARGET=RMAppManager RESULT=SUCCESS APPID=application_1471268320166_0001 2016-08-15 19:08:40,759 INFO [SchedulerEventDispatcher:Event Processor] capacity.ParentQueue (ParentQueue.java:removeApplication(375)) - Application removed - appId: application_1471268320166_0001 user: user_0 leaf-queue of parent: a #applications: 0 2016-08-15 19:08:40,761 INFO [SchedulerEventDispatcher:Event Processor] capacity.ParentQueue (ParentQueue.java:removeApplication(375)) - Application removed - appId: application_1471268320166_0001 user: user_0 leaf-queue of parent: root #applications: 0 2016-08-15 19:08:40,762 INFO [AsyncDispatcher event handler] resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(196)) - appId=application_1471268320166_0001,name=test-move-1,user=user_0,queue=a1,state=KILLED,trackingUrl=http://localhost:8088/cluster/app/application_1471268320166_0001,appMasterHost=N/A,startTime=1471268320404,finishTime=1471268320750,finalStatus=KILLED,memorySeconds=0,vcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=,applicationType=YARN 2016-08-15 19:08:40,762 DEBUG [main] service.AbstractService (AbstractService.java:enterState(452)) - Service: org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter entered state STOPPED 2016-08-15 19:08:40,763 DEBUG [main] service.CompositeService (CompositeService.java:serviceStop(129)) - org.apache.hadoop.yarn.server.resourcemanager.ahs.RMApplicationHistoryWriter: stopping services, size=0 2016-08-15 19:08:40,763 DEBUG [main] service.CompositeService (CompositeService.java:stop(151)) - Stopping service #1: Service org.apache.hadoop.yarn.server.resourcemanager.AdminService in state org.apache.hadoop.yarn.server.resourcemanager.AdminService: INITED 2016-08-15 19:08:40,763 DEBUG [main] service.AbstractService (AbstractService.java:enterState(452)) - Service: org.apache.hadoop.yarn.server.resourcemanager.AdminService entered state STOPPED 2016-08-15 19:08:40,764 DEBUG [main] service.CompositeService (CompositeService.java:serviceStop(129)) - org.apache.hadoop.yarn.server.resourcemanager.AdminService: stopping services, size=0 2016-08-15 19:08:40,764 DEBUG [main] service.CompositeService (CompositeService.java:stop(151)) - Stopping service #0: Service Dispatcher in state Dispatcher: STARTED 2016-08-15 19:08:40,764 DEBUG [main] service.AbstractService (AbstractService.java:enterState(452)) - Service: Dispatcher entered state STOPPED 2016-08-15 19:08:40,764 INFO [main] resourcemanager.ResourceManager (ResourceManager.java:transitionToStandby(1108)) - Transitioning to standby state 2016-08-15 19:08:40,765 INFO [main] resourcemanager.ResourceManager (ResourceManager.java:transitionToStandby(1115)) - Transitioned to standby state