2016-10-19 16:58:27,251 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1475850791417_0120_000001 2016-10-19 16:58:27,765 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2016-10-19 16:58:27,825 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens: 2016-10-19 16:58:27,825 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { id: 120 cluster_timestamp: 1475850791417 } attemptId: 1 } keyId: -998955702) 2016-10-19 16:58:27,957 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: HDFS_DELEGATION_TOKEN, Service: ha-hdfs:sandbox, Ident: (HDFS_DELEGATION_TOKEN token 12449 for shfs3453) 2016-10-19 16:58:28,055 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: dfs.datanode.data.dir; Ignoring. 2016-10-19 16:58:28,702 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter 2016-10-19 16:58:28,705 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter 2016-10-19 16:58:28,756 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.jobhistory.EventType for class org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler 2016-10-19 16:58:28,757 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher 2016-10-19 16:58:28,758 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher 2016-10-19 16:58:28,759 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher 2016-10-19 16:58:28,760 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler 2016-10-19 16:58:28,766 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher 2016-10-19 16:58:28,766 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter 2016-10-19 16:58:28,767 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter 2016-10-19 16:58:28,813 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://sandbox:8020] 2016-10-19 16:58:28,839 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://sandbox:8020] 2016-10-19 16:58:28,864 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://sandbox:8020] 2016-10-19 16:58:28,888 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Emitting job history data to the timeline server is not enabled 2016-10-19 16:58:28,937 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler 2016-10-19 16:58:29,182 INFO [main] org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties 2016-10-19 16:58:29,248 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). 2016-10-19 16:58:29,248 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system started 2016-10-19 16:58:29,259 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for job_1475850791417_0120 to jobTokenSecretManager 2016-10-19 16:58:29,382 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing job_1475850791417_0120 because: not enabled; 2016-10-19 16:58:29,408 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job job_1475850791417_0120 = 20. Number of splits = 1 2016-10-19 16:58:29,408 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for job job_1475850791417_0120 = 0 2016-10-19 16:58:29,408 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1475850791417_0120Job Transitioned from NEW to INITED 2016-10-19 16:58:29,410 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching normal, non-uberized, multi-container job job_1475850791417_0120. 2016-10-19 16:58:29,443 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue 2016-10-19 16:58:29,480 INFO [Socket Reader #1 for port 39222] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 39222 2016-10-19 16:58:29,498 INFO [main] org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the server 2016-10-19 16:58:29,543 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: dfs.datanode.data.dir; Ignoring. 2016-10-19 16:58:29,549 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2016-10-19 16:58:29,550 INFO [IPC Server listener on 39222] org.apache.hadoop.ipc.Server: IPC Server listener on 39222: starting 2016-10-19 16:58:29,551 INFO [main] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated MRClientService at uabigdata03.bigdata.fr/192.168.200.27:39222 2016-10-19 16:58:29,641 INFO [main] org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2016-10-19 16:58:29,653 INFO [main] org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2016-10-19 16:58:29,658 INFO [main] org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.mapreduce is not defined 2016-10-19 16:58:29,665 INFO [main] org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2016-10-19 16:58:29,703 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: dfs.datanode.data.dir; Ignoring. 2016-10-19 16:58:29,707 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context mapreduce 2016-10-19 16:58:29,707 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context static 2016-10-19 16:58:29,711 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/* 2016-10-19 16:58:29,711 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /ws/* 2016-10-19 16:58:30,060 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules 2016-10-19 16:58:30,062 INFO [main] org.apache.hadoop.http.HttpServer2: Jetty bound to port 35810 2016-10-19 16:58:30,062 INFO [main] org.mortbay.log: jetty-6.1.26 2016-10-19 16:58:30,092 INFO [main] org.mortbay.log: Extract jar:file:/opt/application/Hadoop/hadoop-2.7.2/share/hadoop/yarn/hadoop-yarn-common-2.7.2.jar!/webapps/mapreduce to /tmp/Jetty_0_0_0_0_35810_mapreduce____.8tpq70/webapp 2016-10-19 16:58:31,324 INFO [main] org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:35810 2016-10-19 16:58:31,325 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Web app mapreduce started at 35810 2016-10-19 16:58:31,328 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: JOB_CREATE job_1475850791417_0120 2016-10-19 16:58:31,329 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue 2016-10-19 16:58:31,330 INFO [Socket Reader #1 for port 34963] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 34963 2016-10-19 16:58:31,382 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: dfs.datanode.data.dir; Ignoring. 2016-10-19 16:58:31,386 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2016-10-19 16:58:31,386 INFO [IPC Server listener on 34963] org.apache.hadoop.ipc.Server: IPC Server listener on 34963: starting 2016-10-19 16:58:31,409 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: nodeBlacklistingEnabled:true 2016-10-19 16:58:31,409 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: maxTaskFailuresPerNode is 3 2016-10-19 16:58:31,409 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: blacklistDisablePercent is 33 2016-10-19 16:58:31,452 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: dfs.datanode.data.dir; Ignoring. 2016-10-19 16:58:31,493 INFO [main] org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider: Failing over to rm2 2016-10-19 16:58:31,522 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: maxContainerCapability: 2016-10-19 16:58:31,522 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: HQ_IBNF 2016-10-19 16:58:31,526 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Upper limit on the thread pool size is 500 2016-10-19 16:58:31,526 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The thread pool initial size is 10 2016-10-19 16:58:31,528 INFO [main] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 2016-10-19 16:58:31,535 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1475850791417_0120Job Transitioned from INITED to SETUP 2016-10-19 16:58:31,566 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_SETUP 2016-10-19 16:58:31,568 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1475850791417_0120Job Transitioned from SETUP to RUNNING 2016-10-19 16:58:31,624 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved uabigdata05.bigdata.fr to /HZ_002A 2016-10-19 16:58:31,632 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1475850791417_0120_m_000000 Task Transitioned from NEW to SCHEDULED 2016-10-19 16:58:31,633 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-10-19 16:58:31,634 INFO [Thread-51] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: mapResourceRequest: 2016-10-19 16:58:31,659 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer setup for JobId: job_1475850791417_0120, File: hdfs://sandbox:8020/Products/MR/staging/shfs3453/.staging/job_1475850791417_0120/job_1475850791417_0120_1.jhist 2016-10-19 16:58:32,260 INFO [Socket Reader #1 for port 39222] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for shfs3453@SANDBOX.HADOOP (auth:SIMPLE) 2016-10-19 16:58:32,267 INFO [Socket Reader #1 for port 39222] SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for shfs3453@SANDBOX.HADOOP (auth:TOKEN) for protocol=interface org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB 2016-10-19 16:58:32,345 INFO [IPC Server handler 0 on 39222] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Getting task report for MAP job_1475850791417_0120. Report-size will be 1 2016-10-19 16:58:32,400 INFO [IPC Server handler 0 on 39222] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Getting task report for REDUCE job_1475850791417_0120. Report-size will be 0 2016-10-19 16:58:32,525 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0 2016-10-19 16:58:32,558 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1475850791417_0120: ask=3 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=5 2016-10-19 16:58:33,569 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1 2016-10-19 16:58:33,571 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1475850791417_0120_01_000002 to attempt_1475850791417_0120_m_000000_0 2016-10-19 16:58:33,573 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:1 RackLocal:0 2016-10-19 16:58:33,616 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved uabigdata05.bigdata.fr to /HZ_002A 2016-10-19 16:58:33,632 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-jar file on the remote FS is hdfs://sandbox/Products/MR/staging/shfs3453/.staging/job_1475850791417_0120/job.jar 2016-10-19 16:58:33,634 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf file on the remote FS is /Products/MR/staging/shfs3453/.staging/job_1475850791417_0120/job.xml 2016-10-19 16:58:33,637 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #1 tokens and #1 secret keys for NM use for launching container 2016-10-19 16:58:33,637 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of containertokens_dob is 2 2016-10-19 16:58:33,637 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle token in serviceData 2016-10-19 16:58:33,661 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-10-19 16:58:33,665 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1475850791417_0120_01_000002 taskAttempt attempt_1475850791417_0120_m_000000_0 2016-10-19 16:58:33,667 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1475850791417_0120_m_000000_0 2016-10-19 16:58:33,668 INFO [ContainerLauncher #0] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : uabigdata05.bigdata.fr:34717 2016-10-19 16:58:33,724 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1475850791417_0120_m_000000_0 : 13562 2016-10-19 16:58:33,726 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1475850791417_0120_m_000000_0] using containerId: [container_1475850791417_0120_01_000002 on NM: [uabigdata05.bigdata.fr:34717] 2016-10-19 16:58:33,728 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-10-19 16:58:33,729 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1475850791417_0120_m_000000 Task Transitioned from SCHEDULED to RUNNING 2016-10-19 16:58:34,575 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1475850791417_0120: ask=3 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=5 2016-10-19 16:58:35,581 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1475850791417_0120_01_000002 2016-10-19 16:58:35,581 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:1 RackLocal:0 2016-10-19 16:58:35,585 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP 2016-10-19 16:58:35,585 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1475850791417_0120_m_000000_0: Application application_1475850791417_0120 initialization failed (exitCode=255) with output: main : command provided 0 main : user is shfs3453 main : requested yarn user is shfs3453 2016-10-19 16:58:35,586 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1475850791417_0120_01_000002 taskAttempt attempt_1475850791417_0120_m_000000_0 2016-10-19 16:58:35,587 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1475850791417_0120_m_000000_0 2016-10-19 16:58:35,587 INFO [ContainerLauncher #1] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : uabigdata05.bigdata.fr:34717 2016-10-19 16:58:35,606 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_0 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP 2016-10-19 16:58:35,606 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT 2016-10-19 16:58:35,608 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_0 TaskAttempt Transitioned from FAIL_TASK_CLEANUP to FAILED 2016-10-19 16:58:35,615 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved uabigdata05.bigdata.fr to /HZ_002A 2016-10-19 16:58:35,616 INFO [Thread-51] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 1 failures on node uabigdata05.bigdata.fr 2016-10-19 16:58:35,617 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_1 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-10-19 16:58:35,618 INFO [Thread-51] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1475850791417_0120_m_000000_1 to list of failed maps 2016-10-19 16:58:36,582 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:1 RackLocal:0 2016-10-19 16:58:36,584 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1475850791417_0120: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=5 2016-10-19 16:58:37,587 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1 2016-10-19 16:58:37,587 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_1475850791417_0120_01_000003, NodeId: uabigdata05.bigdata.fr:34717, NodeHttpAddress: uabigdata05.bigdata.fr:8042, Resource: , Priority: 5, Token: Token { kind: ContainerToken, service: 192.168.200.29:34717 }, ] to fast fail map 2016-10-19 16:58:37,588 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps 2016-10-19 16:58:37,588 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1475850791417_0120_01_000003 to attempt_1475850791417_0120_m_000000_1 2016-10-19 16:58:37,588 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:2 ContRel:0 HostLocal:1 RackLocal:0 2016-10-19 16:58:37,588 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved uabigdata05.bigdata.fr to /HZ_002A 2016-10-19 16:58:37,589 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_1 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-10-19 16:58:37,590 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1475850791417_0120_01_000003 taskAttempt attempt_1475850791417_0120_m_000000_1 2016-10-19 16:58:37,590 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1475850791417_0120_m_000000_1 2016-10-19 16:58:37,590 INFO [ContainerLauncher #2] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : uabigdata05.bigdata.fr:34717 2016-10-19 16:58:37,604 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1475850791417_0120_m_000000_1 : 13562 2016-10-19 16:58:37,604 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1475850791417_0120_m_000000_1] using containerId: [container_1475850791417_0120_01_000003 on NM: [uabigdata05.bigdata.fr:34717] 2016-10-19 16:58:37,604 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_1 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-10-19 16:58:38,590 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1475850791417_0120: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=5 2016-10-19 16:58:39,593 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1475850791417_0120_01_000003 2016-10-19 16:58:39,593 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:2 ContRel:0 HostLocal:1 RackLocal:0 2016-10-19 16:58:39,593 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_1 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP 2016-10-19 16:58:39,593 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1475850791417_0120_m_000000_1: Application application_1475850791417_0120 initialization failed (exitCode=255) with output: main : command provided 0 main : user is shfs3453 main : requested yarn user is shfs3453 2016-10-19 16:58:39,594 INFO [ContainerLauncher #3] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1475850791417_0120_01_000003 taskAttempt attempt_1475850791417_0120_m_000000_1 2016-10-19 16:58:39,595 INFO [ContainerLauncher #3] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1475850791417_0120_m_000000_1 2016-10-19 16:58:39,595 INFO [ContainerLauncher #3] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : uabigdata05.bigdata.fr:34717 2016-10-19 16:58:39,607 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_1 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP 2016-10-19 16:58:39,607 INFO [CommitterEvent Processor #2] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT 2016-10-19 16:58:39,608 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_1 TaskAttempt Transitioned from FAIL_TASK_CLEANUP to FAILED 2016-10-19 16:58:39,608 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved uabigdata05.bigdata.fr to /HZ_002A 2016-10-19 16:58:39,608 INFO [Thread-51] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 2 failures on node uabigdata05.bigdata.fr 2016-10-19 16:58:39,609 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_2 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-10-19 16:58:39,609 INFO [Thread-51] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1475850791417_0120_m_000000_2 to list of failed maps 2016-10-19 16:58:40,593 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:2 ContRel:0 HostLocal:1 RackLocal:0 2016-10-19 16:58:40,595 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1475850791417_0120: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=5 2016-10-19 16:58:41,598 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1 2016-10-19 16:58:41,599 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_1475850791417_0120_01_000004, NodeId: uabigdata05.bigdata.fr:34717, NodeHttpAddress: uabigdata05.bigdata.fr:8042, Resource: , Priority: 5, Token: Token { kind: ContainerToken, service: 192.168.200.29:34717 }, ] to fast fail map 2016-10-19 16:58:41,599 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps 2016-10-19 16:58:41,599 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1475850791417_0120_01_000004 to attempt_1475850791417_0120_m_000000_2 2016-10-19 16:58:41,600 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:3 ContRel:0 HostLocal:1 RackLocal:0 2016-10-19 16:58:41,600 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved uabigdata05.bigdata.fr to /HZ_002A 2016-10-19 16:58:41,600 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_2 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-10-19 16:58:41,602 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1475850791417_0120_01_000004 taskAttempt attempt_1475850791417_0120_m_000000_2 2016-10-19 16:58:41,602 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1475850791417_0120_m_000000_2 2016-10-19 16:58:41,602 INFO [ContainerLauncher #4] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : uabigdata05.bigdata.fr:34717 2016-10-19 16:58:41,616 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1475850791417_0120_m_000000_2 : 13562 2016-10-19 16:58:41,616 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1475850791417_0120_m_000000_2] using containerId: [container_1475850791417_0120_01_000004 on NM: [uabigdata05.bigdata.fr:34717] 2016-10-19 16:58:41,616 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_2 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-10-19 16:58:42,602 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1475850791417_0120: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=5 2016-10-19 16:58:43,604 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1475850791417_0120_01_000004 2016-10-19 16:58:43,604 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:3 ContRel:0 HostLocal:1 RackLocal:0 2016-10-19 16:58:43,604 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_2 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP 2016-10-19 16:58:43,605 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1475850791417_0120_m_000000_2: Application application_1475850791417_0120 initialization failed (exitCode=255) with output: main : command provided 0 main : user is shfs3453 main : requested yarn user is shfs3453 2016-10-19 16:58:43,606 INFO [ContainerLauncher #5] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1475850791417_0120_01_000004 taskAttempt attempt_1475850791417_0120_m_000000_2 2016-10-19 16:58:43,606 INFO [ContainerLauncher #5] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1475850791417_0120_m_000000_2 2016-10-19 16:58:43,606 INFO [ContainerLauncher #5] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : uabigdata05.bigdata.fr:34717 2016-10-19 16:58:43,617 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_2 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP 2016-10-19 16:58:43,618 INFO [CommitterEvent Processor #3] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT 2016-10-19 16:58:43,618 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_2 TaskAttempt Transitioned from FAIL_TASK_CLEANUP to FAILED 2016-10-19 16:58:43,619 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved uabigdata05.bigdata.fr to /HZ_002A 2016-10-19 16:58:43,619 INFO [Thread-51] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 3 failures on node uabigdata05.bigdata.fr 2016-10-19 16:58:43,619 INFO [Thread-51] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: Blacklisted host uabigdata05.bigdata.fr 2016-10-19 16:58:43,619 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_3 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-10-19 16:58:43,620 INFO [Thread-51] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1475850791417_0120_m_000000_3 to list of failed maps 2016-10-19 16:58:44,604 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:3 ContRel:0 HostLocal:1 RackLocal:0 2016-10-19 16:58:44,606 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1475850791417_0120: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=5 2016-10-19 16:58:44,607 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: Update the blacklist for application_1475850791417_0120: blacklistAdditions=1 blacklistRemovals=0 2016-10-19 16:58:45,611 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1 2016-10-19 16:58:45,611 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_1475850791417_0120_01_000005, NodeId: uabigdata06.bigdata.fr:60737, NodeHttpAddress: uabigdata06.bigdata.fr:8042, Resource: , Priority: 5, Token: Token { kind: ContainerToken, service: 192.168.200.30:60737 }, ] to fast fail map 2016-10-19 16:58:45,611 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps 2016-10-19 16:58:45,612 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1475850791417_0120_01_000005 to attempt_1475850791417_0120_m_000000_3 2016-10-19 16:58:45,612 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:4 ContRel:0 HostLocal:1 RackLocal:0 2016-10-19 16:58:45,639 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved uabigdata06.bigdata.fr to /HZ_002A 2016-10-19 16:58:45,640 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_3 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-10-19 16:58:45,640 INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1475850791417_0120_01_000005 taskAttempt attempt_1475850791417_0120_m_000000_3 2016-10-19 16:58:45,641 INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1475850791417_0120_m_000000_3 2016-10-19 16:58:45,641 INFO [ContainerLauncher #6] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : uabigdata06.bigdata.fr:60737 2016-10-19 16:58:45,654 INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1475850791417_0120_m_000000_3 : 13562 2016-10-19 16:58:45,654 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1475850791417_0120_m_000000_3] using containerId: [container_1475850791417_0120_01_000005 on NM: [uabigdata06.bigdata.fr:60737] 2016-10-19 16:58:45,654 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_3 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-10-19 16:58:46,614 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1475850791417_0120: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=5 2016-10-19 16:58:47,617 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1475850791417_0120_01_000005 2016-10-19 16:58:47,618 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:4 ContRel:0 HostLocal:1 RackLocal:0 2016-10-19 16:58:47,618 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_3 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP 2016-10-19 16:58:47,618 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1475850791417_0120_m_000000_3: Application application_1475850791417_0120 initialization failed (exitCode=255) with output: main : command provided 0 main : user is shfs3453 main : requested yarn user is shfs3453 2016-10-19 16:58:47,619 INFO [ContainerLauncher #7] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1475850791417_0120_01_000005 taskAttempt attempt_1475850791417_0120_m_000000_3 2016-10-19 16:58:47,619 INFO [ContainerLauncher #7] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1475850791417_0120_m_000000_3 2016-10-19 16:58:47,620 INFO [ContainerLauncher #7] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : uabigdata06.bigdata.fr:60737 2016-10-19 16:58:47,631 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_3 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP 2016-10-19 16:58:47,631 INFO [CommitterEvent Processor #4] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT 2016-10-19 16:58:47,632 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1475850791417_0120_m_000000_3 TaskAttempt Transitioned from FAIL_TASK_CLEANUP to FAILED 2016-10-19 16:58:47,634 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1475850791417_0120_m_000000 Task Transitioned from RUNNING to FAILED 2016-10-19 16:58:47,634 INFO [Thread-51] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 1 failures on node uabigdata06.bigdata.fr 2016-10-19 16:58:47,634 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 1 2016-10-19 16:58:47,635 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Job failed as tasks failed. failedMaps:1 failedReduces:0 2016-10-19 16:58:47,635 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1475850791417_0120Job Transitioned from RUNNING to FAIL_ABORT 2016-10-19 16:58:47,636 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_ABORT 2016-10-19 16:58:47,641 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1475850791417_0120Job Transitioned from FAIL_ABORT to FAILED 2016-10-19 16:58:47,642 INFO [Thread-72] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing cleanly so this is the last retry 2016-10-19 16:58:47,642 INFO [Thread-72] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: true 2016-10-19 16:58:47,642 INFO [Thread-72] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: RMCommunicator notified that shouldUnregistered is: true 2016-10-19 16:58:47,642 INFO [Thread-72] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: true 2016-10-19 16:58:47,642 INFO [Thread-72] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is true 2016-10-19 16:58:47,642 INFO [Thread-72] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the services 2016-10-19 16:58:47,643 INFO [Thread-72] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0 2016-10-19 16:58:47,688 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://sandbox:8020/Products/MR/staging/shfs3453/.staging/job_1475850791417_0120/job_1475850791417_0120_1.jhist to hdfs://sandbox:8020/Products/MR/history/tmp/shfs3453/job_1475850791417_0120-1476889101999-shfs3453-INSERT+INTO+TABLE+test_table+...%27Nederland%27%29%28Stage-1476889127635-0-0-FAILED-HQ_IBNF-1476889111530.jhist_tmp 2016-10-19 16:58:47,718 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://sandbox:8020/Products/MR/history/tmp/shfs3453/job_1475850791417_0120-1476889101999-shfs3453-INSERT+INTO+TABLE+test_table+...%27Nederland%27%29%28Stage-1476889127635-0-0-FAILED-HQ_IBNF-1476889111530.jhist_tmp 2016-10-19 16:58:47,723 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://sandbox:8020/Products/MR/staging/shfs3453/.staging/job_1475850791417_0120/job_1475850791417_0120_1_conf.xml to hdfs://sandbox:8020/Products/MR/history/tmp/shfs3453/job_1475850791417_0120_conf.xml_tmp 2016-10-19 16:58:47,758 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://sandbox:8020/Products/MR/history/tmp/shfs3453/job_1475850791417_0120_conf.xml_tmp 2016-10-19 16:58:47,767 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://sandbox:8020/Products/MR/history/tmp/shfs3453/job_1475850791417_0120.summary_tmp to hdfs://sandbox:8020/Products/MR/history/tmp/shfs3453/job_1475850791417_0120.summary 2016-10-19 16:58:47,770 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://sandbox:8020/Products/MR/history/tmp/shfs3453/job_1475850791417_0120_conf.xml_tmp to hdfs://sandbox:8020/Products/MR/history/tmp/shfs3453/job_1475850791417_0120_conf.xml 2016-10-19 16:58:47,774 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://sandbox:8020/Products/MR/history/tmp/shfs3453/job_1475850791417_0120-1476889101999-shfs3453-INSERT+INTO+TABLE+test_table+...%27Nederland%27%29%28Stage-1476889127635-0-0-FAILED-HQ_IBNF-1476889111530.jhist_tmp to hdfs://sandbox:8020/Products/MR/history/tmp/shfs3453/job_1475850791417_0120-1476889101999-shfs3453-INSERT+INTO+TABLE+test_table+...%27Nederland%27%29%28Stage-1476889127635-0-0-FAILED-HQ_IBNF-1476889111530.jhist 2016-10-19 16:58:47,775 INFO [Thread-72] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop() 2016-10-19 16:58:47,778 INFO [Thread-72] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job diagnostics to Task failed task_1475850791417_0120_m_000000 Job failed as tasks failed. failedMaps:1 failedReduces:0 2016-10-19 16:58:47,779 INFO [Thread-72] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is http://namenode01.bigdata.fr:19888/jobhistory/job/job_1475850791417_0120 2016-10-19 16:58:47,784 INFO [Thread-72] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for application to be successfully unregistered. 2016-10-19 16:58:48,786 INFO [Thread-72] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:4 ContRel:0 HostLocal:1 RackLocal:0 2016-10-19 16:58:48,787 INFO [Thread-72] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://sandbox /Products/MR/staging/shfs3453/.staging/job_1475850791417_0120 2016-10-19 16:58:48,794 INFO [Thread-72] org.apache.hadoop.ipc.Server: Stopping server on 34963 2016-10-19 16:58:48,797 INFO [IPC Server listener on 34963] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 34963 2016-10-19 16:58:48,797 INFO [TaskHeartbeatHandler PingChecker] org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler thread interrupted 2016-10-19 16:58:48,797 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder