2016-04-07 21:07:27,514 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService (IPC Server handler 41 on 8032): Allocated new applicationId: 7 2016-04-07 21:07:35,874 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService (IPC Server handler 17 on 8032): Application with id 7 submitted by user milesc 2016-04-07 21:07:35,874 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl (AsyncDispatcher event handler): Storing application with id application_1460047303577_0007 2016-04-07 21:07:35,874 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (IPC Server handler 17 on 8032): USER=milesc IP=10.0.0.4 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1460047303577_0007 2016-04-07 21:07:35,874 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl (AsyncDispatcher event handler): application_1460047303577_0007 State change from NEW to NEW_SAVING 2016-04-07 21:07:35,874 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore (AsyncDispatcher event handler): Storing info for app: application_1460047303577_0007 2016-04-07 21:07:35,874 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl (AsyncDispatcher event handler): application_1460047303577_0007 State change from NEW_SAVING to SUBMITTED 2016-04-07 21:07:35,874 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (ResourceManager Event Processor): Accepted application application_1460047303577_0007 from user: milesc, in queue: root.default, currently num of applications: 3 2016-04-07 21:07:35,874 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl (AsyncDispatcher event handler): appattempt_1460047303577_0007_000001 amEmrLabels: MASTER,CORE 2016-04-07 21:07:35,874 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl (AsyncDispatcher event handler): application_1460047303577_0007 State change from SUBMITTED to ACCEPTED 2016-04-07 21:07:35,874 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService (AsyncDispatcher event handler): Registering app attempt : appattempt_1460047303577_0007_000001 2016-04-07 21:07:35,874 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl (AsyncDispatcher event handler): appattempt_1460047303577_0007_000001 State change from NEW to SUBMITTED 2016-04-07 21:07:35,874 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (ResourceManager Event Processor): Added Application Attempt appattempt_1460047303577_0007_000001 to scheduler from user: milesc 2016-04-07 21:07:35,874 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl (AsyncDispatcher event handler): appattempt_1460047303577_0007_000001 State change from SUBMITTED to SCHEDULED 2016-04-07 21:07:58,458 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:07:58,458 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:08:03,459 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:08:03,459 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:08:08,461 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:08:08,461 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:08:13,463 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:08:13,463 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:08:13,463 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptMetrics (FairSchedulerUpdateThread): Non-AM container preempted, current appAttemptId=appattempt_1460047303577_0002_000001, containerId=container_1460047303577_0002_01_001038, resource= 2016-04-07 21:08:13,463 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (FairSchedulerUpdateThread): container_1460047303577_0002_01_001038 Container Transitioned from RUNNING to KILLED 2016-04-07 21:08:13,463 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (FairSchedulerUpdateThread): Completed container: container_1460047303577_0002_01_001038 in state: KILLED event:KILL 2016-04-07 21:08:13,463 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (FairSchedulerUpdateThread): USER=milesc OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001038 2016-04-07 21:08:13,463 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (FairSchedulerUpdateThread): Released container container_1460047303577_0002_01_001038 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which currently has 12 containers, used and available, release resources=true 2016-04-07 21:08:13,463 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Application attempt appattempt_1460047303577_0002_000001 released container container_1460047303577_0002_01_001038 on node: host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used= with event: KILL 2016-04-07 21:08:13,463 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Killing containercontainer_1460047303577_0002_01_001038 (after waiting for premption for 15005ms) 2016-04-07 21:08:13,844 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001039 Container Transitioned from NEW to ALLOCATED 2016-04-07 21:08:13,844 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (ResourceManager Event Processor): USER=milesc OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001039 2016-04-07 21:08:13,844 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Application application_1460047303577_0002 unreserved on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used=, currently has 23 at priority 1; currentReservation 2016-04-07 21:08:13,844 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (ResourceManager Event Processor): Assigned container container_1460047303577_0002_01_001039 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which has 13 containers, used and available after allocation 2016-04-07 21:08:14,555 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 59 on 8030): container_1460047303577_0002_01_001039 Container Transitioned from ALLOCATED to ACQUIRED 2016-04-07 21:08:14,845 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001039 Container Transitioned from ACQUIRED to RUNNING 2016-04-07 21:08:14,845 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (ResourceManager Event Processor): Null container completed... 2016-04-07 21:08:14,845 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Making reservation: node=ip-10-12-40-63.us-west-2.compute.internal app_id=application_1460047303577_0002 2016-04-07 21:08:14,845 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001040 Container Transitioned from NEW to RESERVED 2016-04-07 21:08:14,845 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSSchedulerNode (ResourceManager Event Processor): Reserved container container_1460047303577_0002_01_001040 on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=13 available= used= for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@282da358 2016-04-07 21:08:18,465 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:08:18,465 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:08:23,467 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:08:23,467 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:08:28,469 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:08:28,469 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:08:33,470 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:08:33,470 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:08:33,470 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptMetrics (FairSchedulerUpdateThread): Non-AM container preempted, current appAttemptId=appattempt_1460047303577_0002_000001, containerId=container_1460047303577_0002_01_001039, resource= 2016-04-07 21:08:33,470 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (FairSchedulerUpdateThread): container_1460047303577_0002_01_001039 Container Transitioned from RUNNING to KILLED 2016-04-07 21:08:33,470 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (FairSchedulerUpdateThread): Completed container: container_1460047303577_0002_01_001039 in state: KILLED event:KILL 2016-04-07 21:08:33,470 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (FairSchedulerUpdateThread): USER=milesc OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001039 2016-04-07 21:08:33,470 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (FairSchedulerUpdateThread): Released container container_1460047303577_0002_01_001039 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which currently has 12 containers, used and available, release resources=true 2016-04-07 21:08:33,471 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Application attempt appattempt_1460047303577_0002_000001 released container container_1460047303577_0002_01_001039 on node: host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used= with event: KILL 2016-04-07 21:08:33,471 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Killing containercontainer_1460047303577_0002_01_001039 (after waiting for premption for 15006ms) 2016-04-07 21:08:33,865 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001040 Container Transitioned from NEW to ALLOCATED 2016-04-07 21:08:33,865 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (ResourceManager Event Processor): USER=milesc OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001040 2016-04-07 21:08:33,865 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Application application_1460047303577_0002 unreserved on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used=, currently has 23 at priority 1; currentReservation 2016-04-07 21:08:33,865 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (ResourceManager Event Processor): Assigned container container_1460047303577_0002_01_001040 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which has 13 containers, used and available after allocation 2016-04-07 21:08:34,274 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 57 on 8030): container_1460047303577_0002_01_001040 Container Transitioned from ALLOCATED to ACQUIRED 2016-04-07 21:08:34,866 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001040 Container Transitioned from ACQUIRED to RUNNING 2016-04-07 21:08:34,866 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (ResourceManager Event Processor): Null container completed... 2016-04-07 21:08:34,866 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Making reservation: node=ip-10-12-40-63.us-west-2.compute.internal app_id=application_1460047303577_0002 2016-04-07 21:08:34,866 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001041 Container Transitioned from NEW to RESERVED 2016-04-07 21:08:34,866 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSSchedulerNode (ResourceManager Event Processor): Reserved container container_1460047303577_0002_01_001041 on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=13 available= used= for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@282da358 2016-04-07 21:08:38,472 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:08:38,473 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:08:43,474 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:08:43,474 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:08:48,476 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:08:48,476 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:08:53,478 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:08:53,478 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:08:53,478 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptMetrics (FairSchedulerUpdateThread): Non-AM container preempted, current appAttemptId=appattempt_1460047303577_0002_000001, containerId=container_1460047303577_0002_01_001040, resource= 2016-04-07 21:08:53,478 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (FairSchedulerUpdateThread): container_1460047303577_0002_01_001040 Container Transitioned from RUNNING to KILLED 2016-04-07 21:08:53,478 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (FairSchedulerUpdateThread): Completed container: container_1460047303577_0002_01_001040 in state: KILLED event:KILL 2016-04-07 21:08:53,478 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (FairSchedulerUpdateThread): USER=milesc OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001040 2016-04-07 21:08:53,478 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (FairSchedulerUpdateThread): Released container container_1460047303577_0002_01_001040 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which currently has 12 containers, used and available, release resources=true 2016-04-07 21:08:53,478 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Application attempt appattempt_1460047303577_0002_000001 released container container_1460047303577_0002_01_001040 on node: host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used= with event: KILL 2016-04-07 21:08:53,478 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Killing containercontainer_1460047303577_0002_01_001040 (after waiting for premption for 15005ms) 2016-04-07 21:08:53,889 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001041 Container Transitioned from NEW to ALLOCATED 2016-04-07 21:08:53,889 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (ResourceManager Event Processor): USER=milesc OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001041 2016-04-07 21:08:53,889 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Application application_1460047303577_0002 unreserved on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used=, currently has 23 at priority 1; currentReservation 2016-04-07 21:08:53,889 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (ResourceManager Event Processor): Assigned container container_1460047303577_0002_01_001041 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which has 13 containers, used and available after allocation 2016-04-07 21:08:54,356 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 30 on 8030): container_1460047303577_0002_01_001041 Container Transitioned from ALLOCATED to ACQUIRED 2016-04-07 21:08:54,896 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001041 Container Transitioned from ACQUIRED to RUNNING 2016-04-07 21:08:54,896 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (ResourceManager Event Processor): Null container completed... 2016-04-07 21:08:54,896 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Making reservation: node=ip-10-12-40-63.us-west-2.compute.internal app_id=application_1460047303577_0002 2016-04-07 21:08:54,896 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001042 Container Transitioned from NEW to RESERVED 2016-04-07 21:08:54,896 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSSchedulerNode (ResourceManager Event Processor): Reserved container container_1460047303577_0002_01_001042 on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=13 available= used= for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@282da358 2016-04-07 21:08:58,480 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:08:58,480 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:09:03,482 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:09:03,482 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:09:08,484 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:09:08,484 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:09:13,485 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:09:13,485 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:09:13,485 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptMetrics (FairSchedulerUpdateThread): Non-AM container preempted, current appAttemptId=appattempt_1460047303577_0002_000001, containerId=container_1460047303577_0002_01_001041, resource= 2016-04-07 21:09:13,485 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (FairSchedulerUpdateThread): container_1460047303577_0002_01_001041 Container Transitioned from RUNNING to KILLED 2016-04-07 21:09:13,485 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (FairSchedulerUpdateThread): Completed container: container_1460047303577_0002_01_001041 in state: KILLED event:KILL 2016-04-07 21:09:13,485 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (FairSchedulerUpdateThread): USER=milesc OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001041 2016-04-07 21:09:13,486 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (FairSchedulerUpdateThread): Released container container_1460047303577_0002_01_001041 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which currently has 12 containers, used and available, release resources=true 2016-04-07 21:09:13,486 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Application attempt appattempt_1460047303577_0002_000001 released container container_1460047303577_0002_01_001041 on node: host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used= with event: KILL 2016-04-07 21:09:13,486 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Killing containercontainer_1460047303577_0002_01_001041 (after waiting for premption for 15006ms) 2016-04-07 21:09:13,917 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001042 Container Transitioned from NEW to ALLOCATED 2016-04-07 21:09:13,917 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (ResourceManager Event Processor): USER=milesc OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001042 2016-04-07 21:09:13,917 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Application application_1460047303577_0002 unreserved on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used=, currently has 23 at priority 1; currentReservation 2016-04-07 21:09:13,917 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (ResourceManager Event Processor): Assigned container container_1460047303577_0002_01_001042 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which has 13 containers, used and available after allocation 2016-04-07 21:09:14,332 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 20 on 8030): container_1460047303577_0002_01_001042 Container Transitioned from ALLOCATED to ACQUIRED 2016-04-07 21:09:14,918 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001042 Container Transitioned from ACQUIRED to RUNNING 2016-04-07 21:09:14,918 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (ResourceManager Event Processor): Null container completed... 2016-04-07 21:09:14,918 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Making reservation: node=ip-10-12-40-63.us-west-2.compute.internal app_id=application_1460047303577_0002 2016-04-07 21:09:14,918 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001043 Container Transitioned from NEW to RESERVED 2016-04-07 21:09:14,918 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSSchedulerNode (ResourceManager Event Processor): Reserved container container_1460047303577_0002_01_001043 on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=13 available= used= for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@282da358 2016-04-07 21:09:18,487 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:09:18,487 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:09:23,489 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:09:23,489 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:09:28,491 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:09:28,491 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:09:33,493 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:09:33,493 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:09:33,493 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptMetrics (FairSchedulerUpdateThread): Non-AM container preempted, current appAttemptId=appattempt_1460047303577_0002_000001, containerId=container_1460047303577_0002_01_001042, resource= 2016-04-07 21:09:33,494 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (FairSchedulerUpdateThread): container_1460047303577_0002_01_001042 Container Transitioned from RUNNING to KILLED 2016-04-07 21:09:33,494 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (FairSchedulerUpdateThread): Completed container: container_1460047303577_0002_01_001042 in state: KILLED event:KILL 2016-04-07 21:09:33,494 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (FairSchedulerUpdateThread): USER=milesc OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001042 2016-04-07 21:09:33,494 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (FairSchedulerUpdateThread): Released container container_1460047303577_0002_01_001042 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which currently has 12 containers, used and available, release resources=true 2016-04-07 21:09:33,494 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Application attempt appattempt_1460047303577_0002_000001 released container container_1460047303577_0002_01_001042 on node: host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used= with event: KILL 2016-04-07 21:09:33,494 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Killing containercontainer_1460047303577_0002_01_001042 (after waiting for premption for 15007ms) 2016-04-07 21:09:33,941 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001043 Container Transitioned from NEW to ALLOCATED 2016-04-07 21:09:33,941 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (ResourceManager Event Processor): USER=milesc OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001043 2016-04-07 21:09:33,941 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Application application_1460047303577_0002 unreserved on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used=, currently has 23 at priority 1; currentReservation 2016-04-07 21:09:33,941 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (ResourceManager Event Processor): Assigned container container_1460047303577_0002_01_001043 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which has 13 containers, used and available after allocation 2016-04-07 21:09:34,371 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 61 on 8030): container_1460047303577_0002_01_001043 Container Transitioned from ALLOCATED to ACQUIRED 2016-04-07 21:09:34,911 INFO logs (1243379455@qtp-725832346-56): Aliases are enabled 2016-04-07 21:09:34,943 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001043 Container Transitioned from ACQUIRED to RUNNING 2016-04-07 21:09:34,943 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (ResourceManager Event Processor): Null container completed... 2016-04-07 21:09:34,943 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Making reservation: node=ip-10-12-40-63.us-west-2.compute.internal app_id=application_1460047303577_0002 2016-04-07 21:09:34,943 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001044 Container Transitioned from NEW to RESERVED 2016-04-07 21:09:34,943 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSSchedulerNode (ResourceManager Event Processor): Reserved container container_1460047303577_0002_01_001044 on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=13 available= used= for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@282da358 2016-04-07 21:09:38,495 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:09:38,495 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:09:43,497 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:09:43,497 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:09:48,499 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:09:48,499 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:09:53,501 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:09:53,501 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:09:53,501 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptMetrics (FairSchedulerUpdateThread): Non-AM container preempted, current appAttemptId=appattempt_1460047303577_0002_000001, containerId=container_1460047303577_0002_01_001043, resource= 2016-04-07 21:09:53,501 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (FairSchedulerUpdateThread): container_1460047303577_0002_01_001043 Container Transitioned from RUNNING to KILLED 2016-04-07 21:09:53,501 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (FairSchedulerUpdateThread): Completed container: container_1460047303577_0002_01_001043 in state: KILLED event:KILL 2016-04-07 21:09:53,501 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (FairSchedulerUpdateThread): USER=milesc OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001043 2016-04-07 21:09:53,501 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (FairSchedulerUpdateThread): Released container container_1460047303577_0002_01_001043 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which currently has 12 containers, used and available, release resources=true 2016-04-07 21:09:53,501 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Application attempt appattempt_1460047303577_0002_000001 released container container_1460047303577_0002_01_001043 on node: host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used= with event: KILL 2016-04-07 21:09:53,501 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Killing containercontainer_1460047303577_0002_01_001043 (after waiting for premption for 15006ms) 2016-04-07 21:09:53,966 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001044 Container Transitioned from NEW to ALLOCATED 2016-04-07 21:09:53,966 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (ResourceManager Event Processor): USER=milesc OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001044 2016-04-07 21:09:53,966 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Application application_1460047303577_0002 unreserved on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used=, currently has 23 at priority 1; currentReservation 2016-04-07 21:09:53,966 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (ResourceManager Event Processor): Assigned container container_1460047303577_0002_01_001044 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which has 13 containers, used and available after allocation 2016-04-07 21:09:54,391 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 6 on 8030): container_1460047303577_0002_01_001044 Container Transitioned from ALLOCATED to ACQUIRED 2016-04-07 21:09:54,967 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001044 Container Transitioned from ACQUIRED to RUNNING 2016-04-07 21:09:54,967 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (ResourceManager Event Processor): Null container completed... 2016-04-07 21:09:54,967 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Making reservation: node=ip-10-12-40-63.us-west-2.compute.internal app_id=application_1460047303577_0002 2016-04-07 21:09:54,968 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001045 Container Transitioned from NEW to RESERVED 2016-04-07 21:09:54,968 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSSchedulerNode (ResourceManager Event Processor): Reserved container container_1460047303577_0002_01_001045 on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=13 available= used= for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@282da358 2016-04-07 21:09:58,503 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:09:58,503 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:10:03,505 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:10:03,505 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:10:08,507 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:10:08,507 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:10:13,508 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:10:13,509 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:10:13,509 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptMetrics (FairSchedulerUpdateThread): Non-AM container preempted, current appAttemptId=appattempt_1460047303577_0002_000001, containerId=container_1460047303577_0002_01_001044, resource= 2016-04-07 21:10:13,509 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (FairSchedulerUpdateThread): container_1460047303577_0002_01_001044 Container Transitioned from RUNNING to KILLED 2016-04-07 21:10:13,509 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (FairSchedulerUpdateThread): Completed container: container_1460047303577_0002_01_001044 in state: KILLED event:KILL 2016-04-07 21:10:13,509 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (FairSchedulerUpdateThread): USER=milesc OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001044 2016-04-07 21:10:13,509 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (FairSchedulerUpdateThread): Released container container_1460047303577_0002_01_001044 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which currently has 12 containers, used and available, release resources=true 2016-04-07 21:10:13,509 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Application attempt appattempt_1460047303577_0002_000001 released container container_1460047303577_0002_01_001044 on node: host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used= with event: KILL 2016-04-07 21:10:13,509 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Killing containercontainer_1460047303577_0002_01_001044 (after waiting for premption for 15006ms) 2016-04-07 21:10:13,994 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001045 Container Transitioned from NEW to ALLOCATED 2016-04-07 21:10:13,994 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (ResourceManager Event Processor): USER=milesc OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001045 2016-04-07 21:10:13,994 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Application application_1460047303577_0002 unreserved on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used=, currently has 23 at priority 1; currentReservation 2016-04-07 21:10:13,994 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (ResourceManager Event Processor): Assigned container container_1460047303577_0002_01_001045 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which has 13 containers, used and available after allocation 2016-04-07 21:10:14,375 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 10 on 8030): container_1460047303577_0002_01_001045 Container Transitioned from ALLOCATED to ACQUIRED 2016-04-07 21:10:14,995 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001045 Container Transitioned from ACQUIRED to RUNNING 2016-04-07 21:10:14,996 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (ResourceManager Event Processor): Null container completed... 2016-04-07 21:10:14,996 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Making reservation: node=ip-10-12-40-63.us-west-2.compute.internal app_id=application_1460047303577_0002 2016-04-07 21:10:14,996 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001046 Container Transitioned from NEW to RESERVED 2016-04-07 21:10:14,996 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSSchedulerNode (ResourceManager Event Processor): Reserved container container_1460047303577_0002_01_001046 on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=13 available= used= for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@282da358 2016-04-07 21:10:18,511 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:10:18,511 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:10:23,512 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:10:23,513 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:10:28,514 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:10:28,514 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:10:33,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:10:33,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:10:33,516 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptMetrics (FairSchedulerUpdateThread): Non-AM container preempted, current appAttemptId=appattempt_1460047303577_0002_000001, containerId=container_1460047303577_0002_01_001045, resource= 2016-04-07 21:10:33,516 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (FairSchedulerUpdateThread): container_1460047303577_0002_01_001045 Container Transitioned from RUNNING to KILLED 2016-04-07 21:10:33,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (FairSchedulerUpdateThread): Completed container: container_1460047303577_0002_01_001045 in state: KILLED event:KILL 2016-04-07 21:10:33,516 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (FairSchedulerUpdateThread): USER=milesc OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001045 2016-04-07 21:10:33,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (FairSchedulerUpdateThread): Released container container_1460047303577_0002_01_001045 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which currently has 12 containers, used and available, release resources=true 2016-04-07 21:10:33,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Application attempt appattempt_1460047303577_0002_000001 released container container_1460047303577_0002_01_001045 on node: host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used= with event: KILL 2016-04-07 21:10:33,516 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Killing containercontainer_1460047303577_0002_01_001045 (after waiting for premption for 15005ms) 2016-04-07 21:10:34,017 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001046 Container Transitioned from NEW to ALLOCATED 2016-04-07 21:10:34,017 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (ResourceManager Event Processor): USER=milesc OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001046 2016-04-07 21:10:34,017 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Application application_1460047303577_0002 unreserved on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used=, currently has 23 at priority 1; currentReservation 2016-04-07 21:10:34,017 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (ResourceManager Event Processor): Assigned container container_1460047303577_0002_01_001046 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which has 13 containers, used and available after allocation 2016-04-07 21:10:34,432 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 62 on 8030): container_1460047303577_0002_01_001046 Container Transitioned from ALLOCATED to ACQUIRED 2016-04-07 21:10:35,018 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001046 Container Transitioned from ACQUIRED to RUNNING 2016-04-07 21:10:35,018 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (ResourceManager Event Processor): Null container completed... 2016-04-07 21:10:35,018 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Making reservation: node=ip-10-12-40-63.us-west-2.compute.internal app_id=application_1460047303577_0002 2016-04-07 21:10:35,018 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001047 Container Transitioned from NEW to RESERVED 2016-04-07 21:10:35,018 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSSchedulerNode (ResourceManager Event Processor): Reserved container container_1460047303577_0002_01_001047 on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=13 available= used= for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@282da358 2016-04-07 21:10:38,518 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:10:38,518 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:10:43,520 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:10:43,520 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:10:48,522 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:10:48,522 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:10:53,524 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:10:53,524 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:10:53,524 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptMetrics (FairSchedulerUpdateThread): Non-AM container preempted, current appAttemptId=appattempt_1460047303577_0002_000001, containerId=container_1460047303577_0002_01_001046, resource= 2016-04-07 21:10:53,524 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (FairSchedulerUpdateThread): container_1460047303577_0002_01_001046 Container Transitioned from RUNNING to KILLED 2016-04-07 21:10:53,524 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (FairSchedulerUpdateThread): Completed container: container_1460047303577_0002_01_001046 in state: KILLED event:KILL 2016-04-07 21:10:53,524 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (FairSchedulerUpdateThread): USER=milesc OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001046 2016-04-07 21:10:53,524 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (FairSchedulerUpdateThread): Released container container_1460047303577_0002_01_001046 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which currently has 12 containers, used and available, release resources=true 2016-04-07 21:10:53,524 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Application attempt appattempt_1460047303577_0002_000001 released container container_1460047303577_0002_01_001046 on node: host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used= with event: KILL 2016-04-07 21:10:53,524 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Killing containercontainer_1460047303577_0002_01_001046 (after waiting for premption for 15006ms) 2016-04-07 21:10:54,042 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001047 Container Transitioned from NEW to ALLOCATED 2016-04-07 21:10:54,042 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (ResourceManager Event Processor): USER=milesc OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001047 2016-04-07 21:10:54,042 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Application application_1460047303577_0002 unreserved on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used=, currently has 23 at priority 1; currentReservation 2016-04-07 21:10:54,042 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (ResourceManager Event Processor): Assigned container container_1460047303577_0002_01_001047 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which has 13 containers, used and available after allocation 2016-04-07 21:10:54,493 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 5 on 8030): container_1460047303577_0002_01_001047 Container Transitioned from ALLOCATED to ACQUIRED 2016-04-07 21:10:55,043 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001047 Container Transitioned from ACQUIRED to RUNNING 2016-04-07 21:10:55,044 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (ResourceManager Event Processor): Null container completed... 2016-04-07 21:10:55,044 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Making reservation: node=ip-10-12-40-63.us-west-2.compute.internal app_id=application_1460047303577_0002 2016-04-07 21:10:55,044 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001048 Container Transitioned from NEW to RESERVED 2016-04-07 21:10:55,044 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSSchedulerNode (ResourceManager Event Processor): Reserved container container_1460047303577_0002_01_001048 on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=13 available= used= for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@282da358 2016-04-07 21:10:58,526 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:10:58,526 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:11:03,528 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:11:03,528 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:11:08,530 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:11:08,530 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:11:13,389 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 9 on 8030): container_1460047303577_0004_01_000004 Container Transitioned from RUNNING to RELEASED 2016-04-07 21:11:13,389 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (IPC Server handler 9 on 8030): Completed container: container_1460047303577_0004_01_000004 in state: RELEASED event:RELEASED 2016-04-07 21:11:13,389 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (IPC Server handler 9 on 8030): USER=ai2 IP=10.12.40.200 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0004 CONTAINERID=container_1460047303577_0004_01_000004 2016-04-07 21:11:13,389 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (IPC Server handler 9 on 8030): Released container container_1460047303577_0004_01_000004 of capacity on host ip-10-12-39-122.us-west-2.compute.internal:8041, which currently has 6 containers, used and available, release resources=true 2016-04-07 21:11:13,389 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (IPC Server handler 9 on 8030): Application attempt appattempt_1460047303577_0004_000001 released container container_1460047303577_0004_01_000004 on node: host: ip-10-12-39-122.us-west-2.compute.internal:8041 #containers=6 available= used= with event: RELEASED 2016-04-07 21:11:13,389 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 9 on 8030): container_1460047303577_0004_01_000017 Container Transitioned from RUNNING to RELEASED 2016-04-07 21:11:13,389 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (IPC Server handler 9 on 8030): Completed container: container_1460047303577_0004_01_000017 in state: RELEASED event:RELEASED 2016-04-07 21:11:13,389 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (IPC Server handler 9 on 8030): USER=ai2 IP=10.12.40.200 OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0004 CONTAINERID=container_1460047303577_0004_01_000017 2016-04-07 21:11:13,389 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (IPC Server handler 9 on 8030): Released container container_1460047303577_0004_01_000017 of capacity on host ip-10-12-39-122.us-west-2.compute.internal:8041, which currently has 5 containers, used and available, release resources=true 2016-04-07 21:11:13,389 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (IPC Server handler 9 on 8030): Application attempt appattempt_1460047303577_0004_000001 released container container_1460047303577_0004_01_000017 on node: host: ip-10-12-39-122.us-west-2.compute.internal:8041 #containers=5 available= used= with event: RELEASED 2016-04-07 21:11:13,532 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:11:13,532 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:11:13,532 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptMetrics (FairSchedulerUpdateThread): Non-AM container preempted, current appAttemptId=appattempt_1460047303577_0002_000001, containerId=container_1460047303577_0002_01_001047, resource= 2016-04-07 21:11:13,532 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (FairSchedulerUpdateThread): container_1460047303577_0002_01_001047 Container Transitioned from RUNNING to KILLED 2016-04-07 21:11:13,532 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (FairSchedulerUpdateThread): Completed container: container_1460047303577_0002_01_001047 in state: KILLED event:KILL 2016-04-07 21:11:13,532 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (FairSchedulerUpdateThread): USER=milesc OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001047 2016-04-07 21:11:13,532 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (FairSchedulerUpdateThread): Released container container_1460047303577_0002_01_001047 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which currently has 12 containers, used and available, release resources=true 2016-04-07 21:11:13,532 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Application attempt appattempt_1460047303577_0002_000001 released container container_1460047303577_0002_01_001047 on node: host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used= with event: KILL 2016-04-07 21:11:13,532 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Killing containercontainer_1460047303577_0002_01_001047 (after waiting for premption for 15006ms) 2016-04-07 21:11:13,928 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_000697 Container Transitioned from NEW to ALLOCATED 2016-04-07 21:11:13,928 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (ResourceManager Event Processor): USER=milesc OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_000697 2016-04-07 21:11:13,928 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Application application_1460047303577_0002 unreserved on node host: ip-10-12-39-122.us-west-2.compute.internal:8041 #containers=5 available= used=, currently has 23 at priority 1; currentReservation 2016-04-07 21:11:13,928 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (ResourceManager Event Processor): Assigned container container_1460047303577_0002_01_000697 of capacity on host ip-10-12-39-122.us-west-2.compute.internal:8041, which has 6 containers, used and available after allocation 2016-04-07 21:11:14,072 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001048 Container Transitioned from NEW to ALLOCATED 2016-04-07 21:11:14,072 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (ResourceManager Event Processor): USER=milesc OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001048 2016-04-07 21:11:14,072 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Application application_1460047303577_0002 unreserved on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=12 available= used=, currently has 22 at priority 1; currentReservation 2016-04-07 21:11:14,072 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (ResourceManager Event Processor): Assigned container container_1460047303577_0002_01_001048 of capacity on host ip-10-12-40-63.us-west-2.compute.internal:8041, which has 13 containers, used and available after allocation 2016-04-07 21:11:14,493 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 14 on 8030): container_1460047303577_0002_01_000697 Container Transitioned from ALLOCATED to ACQUIRED 2016-04-07 21:11:14,493 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 14 on 8030): container_1460047303577_0002_01_001048 Container Transitioned from ALLOCATED to ACQUIRED 2016-04-07 21:11:14,929 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_000697 Container Transitioned from ACQUIRED to RUNNING 2016-04-07 21:11:14,929 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (ResourceManager Event Processor): Null container completed... 2016-04-07 21:11:14,929 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (ResourceManager Event Processor): Null container completed... 2016-04-07 21:11:14,929 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001049 Container Transitioned from NEW to ALLOCATED 2016-04-07 21:11:14,929 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (ResourceManager Event Processor): USER=milesc OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001049 2016-04-07 21:11:14,929 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (ResourceManager Event Processor): Assigned container container_1460047303577_0002_01_001049 of capacity on host ip-10-12-39-122.us-west-2.compute.internal:8041, which has 7 containers, used and available after allocation 2016-04-07 21:11:15,073 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001048 Container Transitioned from ACQUIRED to RUNNING 2016-04-07 21:11:15,073 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (ResourceManager Event Processor): Null container completed... 2016-04-07 21:11:15,073 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Making reservation: node=ip-10-12-40-63.us-west-2.compute.internal app_id=application_1460047303577_0002 2016-04-07 21:11:15,073 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001050 Container Transitioned from NEW to RESERVED 2016-04-07 21:11:15,073 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSSchedulerNode (ResourceManager Event Processor): Reserved container container_1460047303577_0002_01_001050 on node host: ip-10-12-40-63.us-west-2.compute.internal:8041 #containers=13 available= used= for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@282da358 2016-04-07 21:11:15,104 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 27 on 8030): container_1460047303577_0002_01_001049 Container Transitioned from ALLOCATED to ACQUIRED 2016-04-07 21:11:15,930 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001049 Container Transitioned from ACQUIRED to RUNNING 2016-04-07 21:11:15,930 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001051 Container Transitioned from NEW to ALLOCATED 2016-04-07 21:11:15,930 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (ResourceManager Event Processor): USER=milesc OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001051 2016-04-07 21:11:15,930 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (ResourceManager Event Processor): Assigned container container_1460047303577_0002_01_001051 of capacity on host ip-10-12-39-122.us-west-2.compute.internal:8041, which has 8 containers, used and available after allocation 2016-04-07 21:11:16,931 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001052 Container Transitioned from NEW to ALLOCATED 2016-04-07 21:11:16,931 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (ResourceManager Event Processor): USER=milesc OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001052 2016-04-07 21:11:16,931 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (ResourceManager Event Processor): Assigned container container_1460047303577_0002_01_001052 of capacity on host ip-10-12-39-122.us-west-2.compute.internal:8041, which has 9 containers, used and available after allocation 2016-04-07 21:11:17,508 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 12 on 8030): container_1460047303577_0002_01_001051 Container Transitioned from ALLOCATED to ACQUIRED 2016-04-07 21:11:17,508 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 12 on 8030): container_1460047303577_0002_01_001052 Container Transitioned from ALLOCATED to ACQUIRED 2016-04-07 21:11:17,932 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001051 Container Transitioned from ACQUIRED to RUNNING 2016-04-07 21:11:17,932 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001052 Container Transitioned from ACQUIRED to RUNNING 2016-04-07 21:11:17,932 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001053 Container Transitioned from NEW to ALLOCATED 2016-04-07 21:11:17,932 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (ResourceManager Event Processor): USER=milesc OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001053 2016-04-07 21:11:17,932 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (ResourceManager Event Processor): Assigned container container_1460047303577_0002_01_001053 of capacity on host ip-10-12-39-122.us-west-2.compute.internal:8041, which has 10 containers, used and available after allocation 2016-04-07 21:11:18,534 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:11:18,534 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc 2016-04-07 21:11:18,936 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001054 Container Transitioned from NEW to ALLOCATED 2016-04-07 21:11:18,936 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (ResourceManager Event Processor): USER=milesc OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001054 2016-04-07 21:11:18,936 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (ResourceManager Event Processor): Assigned container container_1460047303577_0002_01_001054 of capacity on host ip-10-12-39-122.us-west-2.compute.internal:8041, which has 11 containers, used and available after allocation 2016-04-07 21:11:19,937 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001055 Container Transitioned from NEW to ALLOCATED 2016-04-07 21:11:19,937 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (ResourceManager Event Processor): USER=milesc OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001055 2016-04-07 21:11:19,937 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (ResourceManager Event Processor): Assigned container container_1460047303577_0002_01_001055 of capacity on host ip-10-12-39-122.us-west-2.compute.internal:8041, which has 12 containers, used and available after allocation 2016-04-07 21:11:20,513 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 32 on 8030): container_1460047303577_0002_01_001053 Container Transitioned from ALLOCATED to ACQUIRED 2016-04-07 21:11:20,513 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 32 on 8030): container_1460047303577_0002_01_001054 Container Transitioned from ALLOCATED to ACQUIRED 2016-04-07 21:11:20,513 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (IPC Server handler 32 on 8030): container_1460047303577_0002_01_001055 Container Transitioned from ALLOCATED to ACQUIRED 2016-04-07 21:11:20,939 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001053 Container Transitioned from ACQUIRED to RUNNING 2016-04-07 21:11:20,939 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001054 Container Transitioned from ACQUIRED to RUNNING 2016-04-07 21:11:20,939 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001055 Container Transitioned from ACQUIRED to RUNNING 2016-04-07 21:11:20,939 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001056 Container Transitioned from NEW to ALLOCATED 2016-04-07 21:11:20,939 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger (ResourceManager Event Processor): USER=milesc OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1460047303577_0002 CONTAINERID=container_1460047303577_0002_01_001056 2016-04-07 21:11:20,939 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode (ResourceManager Event Processor): Assigned container container_1460047303577_0002_01_001056 of capacity on host ip-10-12-39-122.us-west-2.compute.internal:8041, which has 13 containers, used and available after allocation 2016-04-07 21:11:21,941 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt (ResourceManager Event Processor): Making reservation: node=ip-10-12-39-122.us-west-2.compute.internal app_id=application_1460047303577_0002 2016-04-07 21:11:21,941 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl (ResourceManager Event Processor): container_1460047303577_0002_01_001057 Container Transitioned from NEW to RESERVED 2016-04-07 21:11:21,941 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSSchedulerNode (ResourceManager Event Processor): Reserved container container_1460047303577_0002_01_001057 on node host: ip-10-12-39-122.us-west-2.compute.internal:8041 #containers=13 available= used= for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt@282da358 2016-04-07 21:11:23,536 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Should preempt res for queue root.default: resDueToMinShare = , resDueToFairShare = 2016-04-07 21:11:23,536 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler (FairSchedulerUpdateThread): Preempting container (prio=1res=) from queue root.milesc etc etc...