2015-10-13 07:42:51,787 DEBUG [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(838)) - Processing event for appattempt_1444702329986_0001_000001 of type ATTEMPT_ADDED 2015-10-13 07:42:51,788 DEBUG [AsyncDispatcher event handler] blacklist.SimpleBlacklistManager (SimpleBlacklistManager.java:getBlacklistUpdates(69)) - blacklist size 0 is less than failure threshold ratio 0.800000011920929 out of total usable nodes 1 2015-10-13 07:42:51,789 DEBUG [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:transition(1006)) - Using blacklist for AM: additions([]) and removals([]) 2015-10-13 07:42:51,790 DEBUG [AsyncDispatcher event handler] capacity.CapacityScheduler (CapacityScheduler.java:allocate(893)) - allocate: pre-update appattempt_1444702329986_0001_000001 ask size =1 2015-10-13 07:42:51,791 DEBUG [AsyncDispatcher event handler] scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(320)) - update: application=application_1444702329986_0001 request={Priority: 0, Capability: , # Containers: 1, Location: *, Relax Locality: true, Node Label Expression: } 2015-10-13 07:42:51,791 DEBUG [AsyncDispatcher event handler] scheduler.ActiveUsersManager (ActiveUsersManager.java:activateApplication(68)) - User root added to activeUsers, currently: 1 2015-10-13 07:42:51,791 DEBUG [AsyncDispatcher event handler] capacity.CapacityScheduler (CapacityScheduler.java:allocate(904)) - allocate: post-update 2015-10-13 07:42:51,792 DEBUG [AsyncDispatcher event handler] scheduler.SchedulerApplicationAttempt (SchedulerApplicationAttempt.java:showRequests(459)) - showRequests: application=application_1444702329986_0001 headRoom= currentConsumption=0 2015-10-13 07:42:51,792 DEBUG [AsyncDispatcher event handler] scheduler.SchedulerApplicationAttempt (SchedulerApplicationAttempt.java:showRequests(463)) - showRequests: application=application_1444702329986_0001 request={Priority: 0, Capability: , # Containers: 1, Location: *, Relax Locality: true, Node Label Expression: } 2015-10-13 07:42:51,794 INFO [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(850)) - appattempt_1444702329986_0001_000001 State change from SUBMITTED to SCHEDULED 2015-10-13 07:42:51,794 INFO [Thread-3] resourcemanager.MockRM (MockRM.java:waitForState(194)) - Attempt State is : SCHEDULED 2015-10-13 07:43:11,871 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(174)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeStatusEvent.EventType: STATUS_UPDATE 2015-10-13 07:43:11,871 DEBUG [AsyncDispatcher event handler] rmnode.RMNodeImpl (RMNodeImpl.java:handle(554)) - Processing unknownhost:1234 of type STATUS_UPDATE 2015-10-13 07:43:11,871 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(174)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.NodeUpdateSchedulerEvent.EventType: NODE_UPDATE 2015-10-13 07:43:11,872 DEBUG [ResourceManager Event Processor] capacity.CapacityScheduler (CapacityScheduler.java:nodeUpdate(967)) - nodeUpdate: unknownhost:1234 clusterResources: 2015-10-13 07:43:11,872 DEBUG [ResourceManager Event Processor] capacity.CapacityScheduler (CapacityScheduler.java:nodeUpdate(1020)) - Node being looked for scheduling unknownhost:1234 availableResource: 2015-10-13 07:43:24,831 DEBUG [ResourceManager Event Processor] capacity.CapacityScheduler (CapacityScheduler.java:allocateContainersToNode(1167)) - Trying to schedule on node: unknownhost, available: 2015-10-13 07:43:24,833 DEBUG [ResourceManager Event Processor] capacity.ParentQueue (ParentQueue.java:assignContainers(408)) - Trying to assign containers to child-queue of root 2015-10-13 07:43:24,838 DEBUG [ResourceManager Event Processor] capacity.ParentQueue (ParentQueue.java:printChildQueues(617)) - printChildQueues - queue: root child-queues: root.defaultusedCapacity=(0.0), label=(*) 2015-10-13 07:43:24,838 DEBUG [ResourceManager Event Processor] capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(564)) - Trying to assign to queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=1, numContainers=0 2015-10-13 07:43:24,839 DEBUG [ResourceManager Event Processor] capacity.LeafQueue (LeafQueue.java:assignContainers(760)) - assignContainers: node=unknownhost #applications=1 2015-10-13 07:43:24,840 DEBUG [ResourceManager Event Processor] capacity.LeafQueue (LeafQueue.java:computeUserLimit(1033)) - User limit computation for root in queue default userLimitPercent=100 userLimitFactor=1.0 required: consumed: user-limit-resource: queueCapacity: qconsumed: currentCapacity: activeUsers: 1 clusterCapacity: 2015-10-13 07:43:24,840 DEBUG [ResourceManager Event Processor] capacity.LeafQueue (LeafQueue.java:computeUserLimitAndSetHeadroom(927)) - Headroom calculation for user root: userLimit= queueMaxAvailRes= consumed= headroom= 2015-10-13 07:43:24,841 DEBUG [ResourceManager Event Processor] fica.FiCaSchedulerApp (FiCaSchedulerApp.java:assignContainers(468)) - pre-assignContainers for application application_1444702329986_0001 2015-10-13 07:43:24,845 DEBUG [ResourceManager Event Processor] capacity.LeafQueue (LeafQueue.java:computeUserLimit(1033)) - User limit computation for root in queue default userLimitPercent=100 userLimitFactor=1.0 required: consumed: user-limit-resource: queueCapacity: qconsumed: currentCapacity: activeUsers: 1 clusterCapacity: 2015-10-13 07:43:24,847 DEBUG [ResourceManager Event Processor] scheduler.SchedulerApplicationAttempt (SchedulerApplicationAttempt.java:showRequests(459)) - showRequests: application=application_1444702329986_0001 headRoom= currentConsumption=0 2015-10-13 07:43:24,848 DEBUG [ResourceManager Event Processor] scheduler.SchedulerApplicationAttempt (SchedulerApplicationAttempt.java:showRequests(463)) - showRequests: application=application_1444702329986_0001 request={Priority: 0, Capability: , # Containers: 1, Location: *, Relax Locality: true, Node Label Expression: } 2015-10-13 07:43:24,848 DEBUG [ResourceManager Event Processor] allocator.IncreaseContainerAllocator (IncreaseContainerAllocator.java:assignContainers(184)) - Skip allocating increase request since we don't have any increase request on this node=unknownhost:1234 2015-10-13 07:43:24,851 DEBUG [ResourceManager Event Processor] allocator.RegularContainerAllocator (RegularContainerAllocator.java:assignContainer(404)) - assignContainers: node=unknownhost application=application_1444702329986_0001 priority=0 request={Priority: 0, Capability: , # Containers: 1, Location: *, Relax Locality: true, Node Label Expression: } type=OFF_SWITCH 2015-10-13 07:43:24,875 DEBUG [ResourceManager Event Processor] scheduler.ActiveUsersManager (ActiveUsersManager.java:deactivateApplication(94)) - User root removed from activeUsers, currently: 0 Waiting for am container to be allocated. 2015-10-13 07:43:24,876 DEBUG [ResourceManager Event Processor] scheduler.AppSchedulingInfo (AppSchedulingInfo.java:allocate(586)) - allocate: applicationId=application_1444702329986_0001 container=container_1444702329986_0001_01_000001 host=unknownhost:1234 user=root resource= 2015-10-13 07:43:24,877 DEBUG [ResourceManager Event Processor] rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(423)) - Processing container_1444702329986_0001_01_000001 of type START 2015-10-13 07:43:24,878 INFO [ResourceManager Event Processor] rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(435)) - container_1444702329986_0001_01_000001 Container Transitioned from NEW to ALLOCATED 2015-10-13 07:43:24,878 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(174)) - Dispatching the event org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.event.RMAppAttemptContainerAllocatedEvent.EventType: CONTAINER_ALLOCATED 2015-10-13 07:43:24,878 DEBUG [ResourceManager Event Processor] fica.FiCaSchedulerApp (FiCaSchedulerApp.java:allocate(199)) - allocate: applicationAttemptId=appattempt_1444702329986_0001_000001 container=container_1444702329986_0001_01_000001 host=unknownhost type=OFF_SWITCH 2015-10-13 07:43:24,878 DEBUG [AsyncDispatcher event handler] attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(838)) - Processing event for appattempt_1444702329986_0001_000001 of type CONTAINER_ALLOCATED 2015-10-13 07:43:24,878 INFO [ResourceManager Event Processor] resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(112)) - USER=root OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1444702329986_0001 CONTAINERID=container_1444702329986_0001_01_000001 2015-10-13 07:43:24,879 INFO [ResourceManager Event Processor] scheduler.SchedulerNode (SchedulerNode.java:allocateContainer(154)) - Assigned container container_1444702329986_0001_01_000001 of capacity on host unknownhost:1234, which has 1 containers, used and available after allocation 2015-10-13 07:43:24,880 INFO [ResourceManager Event Processor] allocator.AbstractContainerAllocator (AbstractContainerAllocator.java:getCSAssignmentFromAllocateResult(89)) - assignedContainer application attempt=appattempt_1444702329986_0001_000001 container=container_1444702329986_0001_01_000001 queue=org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.allocator.RegularContainerAllocator@2e9cf8d3 clusterResource= 2015-10-13 07:43:24,881 DEBUG [ResourceManager Event Processor] capacity.LeafQueue (LeafQueue.java:assignContainers(824)) - post-assignContainers for application application_1444702329986_0001 2015-10-13 07:43:24,890 DEBUG [AsyncDispatcher event handler] security.BaseContainerTokenSecretManager (BaseContainerTokenSecretManager.java:createPassword(90)) - Creating password for container_1444702329986_0001_01_000001 for user container_1444702329986_0001_01_000001 (auth:SIMPLE) to be run on NM unknownhost:1234 2015-10-13 07:43:25,042 DEBUG [AsyncDispatcher event handler] security.ContainerTokenIdentifier (ContainerTokenIdentifier.java:write(197)) - Writing ContainerTokenIdentifier to RPC layer: containerId { app_attempt_id { application_id { id: 1 cluster_timestamp: 1444702329986 } attemptId: 1 } id: 1 } nmHostAddr: "unknownhost:1234" appSubmitter: "root" resource { memory: 1024 virtual_cores: 1 } expiryTimeStamp: 1444703004882 masterKeyId: 1793672794 rmIdentifier: 1444702329986 priority { priority: 0 } creationTime: 1444702404875 nodeLabelExpression: "" containerType: APPLICATION_MASTER 2015-10-13 07:43:45,070 DEBUG [AsyncDispatcher event handler] security.ContainerTokenIdentifier (ContainerTokenIdentifier.java:write(197)) - Writing ContainerTokenIdentifier to RPC layer: containerId { app_attempt_id { application_id { id: 1 cluster_timestamp: 1444702329986 } attemptId: 1 } id: 1 } nmHostAddr: "unknownhost:1234" appSubmitter: "root" resource { memory: 1024 virtual_cores: 1 } expiryTimeStamp: 1444703004882 masterKeyId: 1793672794 rmIdentifier: 1444702329986 priority { priority: 0 } creationTime: 1444702404875 nodeLabelExpression: "" containerType: APPLICATION_MASTER Exception ======================= 2015-10-13 07:23:21,221 DEBUG [AsyncDispatcher event handler] security.ContainerTokenIdentifier (ContainerTokenIdentifier.java:write(197)) - Writing ContainerTokenIdentifier to RPC layer: containerId { app_attempt_id { application_id { id: 1 cluster_timestamp: 1444701179688 } attemptId: 1 } id: 1 } nmHostAddr: "unknownhost:1234" appSubmitter: "root" resource { memory: 1024 virtual_cores: 1 } expiryTimeStamp: 1444701801080 masterKeyId: -176259887 rmIdentifier: 1444701179688 priority { priority: 0 } creationTime: 1444701201075 nodeLabelExpression: "" containerType: APPLICATION_MASTER 2015-10-13 07:23:21,221 ERROR [AsyncDispatcher event handler] scheduler.SchedulerApplicationAttempt (SchedulerApplicationAttempt.java:updateContainerAndNMToken(499)) - Error trying to assign container token and NM token to an updated container container_1444701179688_0001_01_000001 java.lang.IllegalArgumentException: java.net.UnknownHostException: unknownhost at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:406) at org.apache.hadoop.yarn.server.utils.BuilderUtils.newContainerToken(BuilderUtils.java:263) at org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager.createContainerToken(RMContainerTokenSecretManager.java:224) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation$TestRMSecretManagerService$1.createContainerToken(TestContainerAllocation.java:295) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerApplicationAttempt.updateContainerAndNMToken(SchedulerApplicationAttempt.java:487) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerApplicationAttempt.pullNewlyAllocatedContainers(SchedulerApplicationAttempt.java:524) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerApp.getAllocation(FiCaSchedulerApp.java:317) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.allocate(CapacityScheduler.java:926) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$AMContainerAllocatedTransition.transition(RMAppAttemptImpl.java:1039) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$AMContainerAllocatedTransition.transition(RMAppAttemptImpl.java:1) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$3(StateMachineFactory.java:290) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:843) at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:1) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:823) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:1) at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:183) at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:109) at java.lang.Thread.run(Thread.java:745) Caused by: java.net.UnknownHostException: unknownhost at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:407) ... 20 more