2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,506 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,506 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,506 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,507 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,507 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,507 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,507 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,507 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,507 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,507 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,507 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,507 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,507 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,507 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,508 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,508 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,508 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,508 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,508 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,508 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,508 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,508 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,508 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,508 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,508 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,509 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,509 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,509 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,509 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,509 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,509 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,509 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,509 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,509 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,509 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,509 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,509 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,509 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,510 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,510 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,510 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,510 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,510 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,510 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,510 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,510 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,510 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,510 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,510 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,510 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,511 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,511 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,511 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,511 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,511 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,511 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,511 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,511 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,511 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,511 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,511 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,512 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,512 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,512 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,512 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,512 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,512 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,512 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,512 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,512 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,512 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,512 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,513 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,513 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,513 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,513 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,513 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,513 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,513 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,513 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,513 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,513 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,513 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,513 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,514 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,514 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,514 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,514 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,514 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,514 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,514 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,514 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,514 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,514 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,514 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,514 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,515 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,515 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,515 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,515 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,515 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,515 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,515 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,515 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,515 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,515 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,515 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,515 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,516 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,517 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,517 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,517 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,517 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,517 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,517 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,517 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,517 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,517 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,517 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,517 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,518 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,518 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,518 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,518 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,518 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,518 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,518 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,518 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,518 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,518 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,518 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,518 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,518 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,519 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,519 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,519 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,519 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,519 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,519 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,519 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,519 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Trying to schedule on node: rndcl58.rt.com, available: 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign containers to child-queue of root 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: root nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.9505152, max-capacity: 1.0 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: printChildQueues - queue: root child-queues: root.dev-dailyusedCapacity=(0.369462), label=(sim)root.mkt-dailyusedCapacity=(0.0), label=(sim,gpu)root.mktusedCapacity=(0.0), label=(sim,gpu)root.devusedCapacity=(8.993347), label=(sim) 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=0 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt-daily stats: mkt-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=10 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.mkt, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.mkt stats: mkt: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=10, numContainers=372, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=2 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Skip this queue=root.dev-daily, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev-daily stats: dev-daily: capacity=0.4, absoluteCapacity=0.4, usedResources=, usedCapacity=0.369462, absoluteUsedCapacity=0.14778481, numApps=2, numContainers=467, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Trying to assign to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: assignContainers: partition= #applications=3 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Check assign to queue: dev nodePartition: , usedResources: , clusterResources: , currentUsedCapacity: 0.86657804, max-capacity: 0.9 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u2: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534424510885_0148_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534424510885_0148 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Skip app_attempt=appattempt_1534488569086_0002_000001, because it doesn't need more resource, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY node-label= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534488569086_0002 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: assignContainers: node=rndcl58.rt.com application=application_1534490472996_0003 priority=105 pendingAsk=,repeat=1> type=NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator: Resetting scheduling opportunities 2018-08-17 15:51:32,519 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.AbstractContainerAllocator: assignedContainer application attempt=appattempt_1534490472996_0003_000001 container=null queue=dev clusterResource= type=NODE_LOCAL requestedPartition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: post-assignContainers for application application_1534490472996_0003 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Assigned to queue: root.dev stats: dev: capacity=0.1, absoluteCapacity=0.1, usedResources=, usedCapacity=8.993347, absoluteUsedCapacity=0.89933467, numApps=3, numContainers=380, effectiveMinResource= , effectiveMaxResource= --> , NODE_LOCAL 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer reserved=false queue=root usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 used= cluster= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: ParentQ=root assignedSoFarInThisIteration= usedCapacity=0.98644465 absoluteUsedCapacity=0.98644465 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Try to commit allocation proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)] 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.UsersManager: userLimit is fetched. userLimit=, userSpecificUserLimit=, schedulingMode=RESPECT_PARTITION_EXCLUSIVITY, partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Headroom calculation for user u1: userLimit= queueMaxAvailRes= consumed= partition= 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue: Used resource= exceeded maxResourceLimit of the queue = 2018-08-17 15:51:32,519 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Failed to accept allocation proposal 2018-08-17 15:51:32,519 DEBUG org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Allocation proposal accepted=false, proposal=New org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.ResourceCommitRequest: ALLOCATED=[(Application=appattempt_1534490472996_0003_000001; Node=rndcl58.rt.com:8039; Resource=)]