2015-04-20,21:36:29,132 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=yarn_admin IP=10.201.10.52 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1428390739155_23973 2015-04-20,21:36:29,132 INFO org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer: application_1428390739155_23973 found existing hdfs token Kind: HDFS_DELEGATION_TOKEN, Service: ha-hdfs:example, Ident: (HDFS_DELEGATION_TOKEN token 3415222 for yarn_admin) 2015-04-20,21:36:29,152 INFO org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer: Renewed delegation-token= [Kind: HDFS_DELEGATION_TOKEN, Service: ha-hdfs:example, Ident: (HDFS_DELEGATION_TOKEN token 3415222 for yarn_admin);exp=1429623389150], for application_1428390739155_23973 2015-04-20,21:36:29,152 INFO org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer: Renew Kind: HDFS_DELEGATION_TOKEN, Service: ha-hdfs:example, Ident: (HDFS_DELEGATION_TOKEN token 3415222 for yarn_admin);exp=1429623389150 in 86399998 ms, appId = application_1428390739155_23973 2015-04-20,21:36:29,152 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1428390739155_23973 2015-04-20,21:36:29,152 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1428390739155_23973 State change from NEW to NEW_SAVING 2015-04-20,21:36:29,152 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1428390739155_23973 2015-04-20,21:36:29,152 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1428390739155_23973 State change from NEW_SAVING to SUBMITTED 2015-04-20,21:36:29,152 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler: Accepted application application_1428390739155_23973 from user: yarn_admin, in queue: default, currently num of applications: 1 2015-04-20,21:36:29,152 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1428390739155_23973 State change from SUBMITTED to ACCEPTED 2015-04-20,21:36:29,152 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1428390739155_23973_000001 2015-04-20,21:36:29,152 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1428390739155_23973_000001 State change from NEW to SUBMITTED 2015-04-20,21:36:29,153 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler: Added Application Attempt appattempt_1428390739155_23973_000001 to scheduler from user: yarn_admin 2015-04-20,21:36:29,153 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1428390739155_23973_000001 State change from SUBMITTED to SCHEDULED 2015-04-20,21:36:29,579 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1428390739155_23973_01_000001 Container Transitioned from NEW to ALLOCATED 2015-04-20,21:36:29,579 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=yarn_admin OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1428390739155_23973 CONTAINERID=container_1428390739155_23973_01_000001 2015-04-20,21:36:29,579 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Assigned container container_1428390739155_23973_01_000001 of capacity on host instance-196.bj:22400, which has 1 containers, used and available after allocation 2015-04-20,21:36:29,580 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : instance-196.bj:22400 for container : container_1428390739155_23973_01_000001 2015-04-20,21:36:29,580 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1428390739155_23973_01_000001 Container Transitioned from ALLOCATED to ACQUIRED 2015-04-20,21:36:29,580 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Clear node set for appattempt_1428390739155_23973_000001 2015-04-20,21:36:29,580 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: Storing attempt: AppId: application_1428390739155_23973 AttemptId: appattempt_1428390739155_23973_000001 MasterContainer: Container: [ContainerId: container_1428390739155_23973_01_000001, NodeId: instance-196.bj:22400, NodeHttpAddress: instance-196.bj:22401, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 10.105.17.180:22400 }, ] 2015-04-20,21:36:29,580 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1428390739155_23973_000001 State change from SCHEDULED to ALLOCATED_SAVING 2015-04-20,21:36:29,580 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1428390739155_23973_000001 State change from ALLOCATED_SAVING to ALLOCATED 2015-04-20,21:36:29,580 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Launching masterappattempt_1428390739155_23973_000001 2015-04-20,21:36:29,582 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_1428390739155_23973_01_000001, NodeId: instance-196.bj:22400, NodeHttpAddress: instance-196.bj:22401, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 10.105.17.180:22400 }, ] for AM appattempt_1428390739155_23973_000001 2015-04-20,21:36:29,582 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Command to launch container container_1428390739155_23973_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir= -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Djava.security.krb5.conf=/home/work/app/yarn/example2/nodemanager/krb5.conf -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1>/stdout 2>/stderr 2015-04-20,21:36:29,582 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1428390739155_23973_000001 2015-04-20,21:36:29,582 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1428390739155_23973_000001 2015-04-20,21:36:29,636 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Done launching container Container: [ContainerId: container_1428390739155_23973_01_000001, NodeId: instance-196.bj:22400, NodeHttpAddress: instance-196.bj:22401, Resource: , Priority: 0, Token: Token { kind: ContainerToken, service: 10.105.17.180:22400 }, ] for AM appattempt_1428390739155_23973_000001 2015-04-20,21:36:29,636 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1428390739155_23973_000001 State change from ALLOCATED to LAUNCHED 2015-04-20,21:36:30,096 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1428390739155_23973_01_000001 Container Transitioned from ACQUIRED to RUNNING 2015-04-20,21:36:35,128 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1428390739155_23973_000001 (auth:SIMPLE) 2015-04-20,21:36:35,137 WARN org.apache.hadoop.security.UserGroupInformation: No groups available for user appattempt_1428390739155_23973_000001 2015-04-20,21:36:35,137 INFO SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for appattempt_1428390739155_23973_000001 (auth:TOKEN) for protocol=interface org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB and addr=/10.105.17.180 2015-04-20,21:36:35,137 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: AM registration appattempt_1428390739155_23973_000001 2015-04-20,21:36:35,137 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=yarn_admin IP=10.105.17.180 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1428390739155_23973 APPATTEMPTID=appattempt_1428390739155_23973_000001 2015-04-20,21:36:35,137 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1428390739155_23973_000001 State change from LAUNCHED to RUNNING 2015-04-20,21:36:35,137 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1428390739155_23973 State change from ACCEPTED to RUNNING 2015-04-20,21:36:36,181 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1428390739155_23973_01_000002 Container Transitioned from NEW to ALLOCATED 2015-04-20,21:36:36,181 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=yarn_admin OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1428390739155_23973 CONTAINERID=container_1428390739155_23973_01_000002 2015-04-20,21:36:36,181 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Assigned container container_1428390739155_23973_01_000002 of capacity on host instance-174.bj:22400, which has 1 containers, used and available after allocation 2015-04-20,21:36:36,181 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1428390739155_23973_01_000003 Container Transitioned from NEW to ALLOCATED 2015-04-20,21:36:36,181 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=yarn_admin OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1428390739155_23973 CONTAINERID=container_1428390739155_23973_01_000003 2015-04-20,21:36:36,181 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Assigned container container_1428390739155_23973_01_000003 of capacity on host instance-200.bj:22400, which has 1 containers, used and available after allocation 2015-04-20,21:36:37,205 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : instance-174.bj:22400 for container : container_1428390739155_23973_01_000002 2015-04-20,21:36:37,205 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1428390739155_23973_01_000002 Container Transitioned from ALLOCATED to ACQUIRED 2015-04-20,21:36:37,205 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : instance-200.bj:22400 for container : container_1428390739155_23973_01_000003 2015-04-20,21:36:37,205 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1428390739155_23973_01_000003 Container Transitioned from ALLOCATED to ACQUIRED 2015-04-20,21:36:38,089 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1428390739155_23973_01_000002 Container Transitioned from ACQUIRED to RUNNING 2015-04-20,21:36:38,241 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1428390739155_23973_01_000003 Container Transitioned from ACQUIRED to RELEASED 2015-04-20,21:36:38,241 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt: Completed container: container_1428390739155_23973_01_000003 in state: RELEASED event:RELEASED 2015-04-20,21:36:38,241 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=yarn_admin IP=10.105.17.180 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1428390739155_23973 CONTAINERID=container_1428390739155_23973_01_000003 2015-04-20,21:36:38,241 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Released container container_1428390739155_23973_01_000003 of capacity on host instance-200.bj:22400, which currently has 0 containers, used and available, release resources=true 2015-04-20,21:36:38,241 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler: Application attempt appattempt_1428390739155_23973_000001 released container container_1428390739155_23973_01_000003 on node: host: instance-200.bj:22400 #containers=0 available=10240 used=0 with event: RELEASED 2015-04-20,21:36:38,245 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1428390739155_23973_01_000004 Container Transitioned from NEW to ALLOCATED 2015-04-20,21:36:38,245 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=yarn_admin OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1428390739155_23973 CONTAINERID=container_1428390739155_23973_01_000004 2015-04-20,21:36:38,245 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Assigned container container_1428390739155_23973_01_000004 of capacity on host instance-200.bj:22400, which has 1 containers, used and available after allocation 2015-04-20,21:36:38,633 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1428390739155_23973_01_000004 Container Transitioned from ALLOCATED to KILLED 2015-04-20,21:36:38,633 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt: Completed container: container_1428390739155_23973_01_000004 in state: KILLED event:KILL 2015-04-20,21:36:38,633 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=yarn_admin OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1428390739155_23973 CONTAINERID=container_1428390739155_23973_01_000004 2015-04-20,21:36:38,634 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Released container container_1428390739155_23973_01_000004 of capacity on host instance-200.bj:22400, which currently has 0 containers, used and available, release resources=true 2015-04-20,21:36:38,634 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler: Application attempt appattempt_1428390739155_23973_000001 released container container_1428390739155_23973_01_000004 on node: host: instance-200.bj:22400 #containers=0 available=10240 used=0 with event: KILL 2015-04-20,21:36:42,276 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1428390739155_23973_01_000002 Container Transitioned from RUNNING to COMPLETED 2015-04-20,21:36:42,276 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt: Completed container: container_1428390739155_23973_01_000002 in state: COMPLETED event:FINISHED 2015-04-20,21:36:42,276 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=yarn_admin OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1428390739155_23973 CONTAINERID=container_1428390739155_23973_01_000002 2015-04-20,21:36:42,276 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode: Released container container_1428390739155_23973_01_000002 of capacity on host instance-174.bj:22400, which currently has 0 containers, used and available, release resources=true 2015-04-20,21:36:42,276 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler: Application attempt appattempt_1428390739155_23973_000001 released container container_1428390739155_23973_01_000002 on node: host: instance-174.bj:22400 #containers=0 available=10240 used=0 with event: FINISHED