2016-02-26 00:02:20,710 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit code from container container_1456425026132_0001_01_000003 is : 143 2016-02-26 00:02:20,745 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1456425026132_0001_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2016-02-26 00:02:20,746 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=naga OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1456425026132_0001 CONTAINERID=container_1456425026132_0001_01_000003 2016-02-26 00:02:20,747 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1456425026132_0001_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2016-02-26 00:02:20,747 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_1456425026132_0001_01_000003 from application application_1456425026132_0001 2016-02-26 00:02:20,747 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1456425026132_0001_01_000003 2016-02-26 00:02:20,747 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1456425026132_0001_01_000003 for log-aggregation 2016-02-26 00:02:20,747 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1456425026132_0001 2016-02-26 00:02:22,758 INFO org.apache.hadoop.yarn.server.nodemanager.timelineservice.NMTimelinePublisher: container usage log for : container_1456425026132_0001_01_000001 2016-02-26 00:02:22,791 INFO org.apache.hadoop.yarn.server.timelineservice.storage.HBaseTimelineWriterImpl: Metric for entity : TimelineEntity[type='YARN_CONTAINER', id='container_1456425026132_0001_01_000001'] 2016-02-26 00:02:25,787 INFO org.apache.hadoop.yarn.server.nodemanager.timelineservice.NMTimelinePublisher: container usage log for : container_1456425026132_0001_01_000001 2016-02-26 00:02:25,819 INFO org.apache.hadoop.yarn.server.timelineservice.storage.HBaseTimelineWriterImpl: Metric for entity : TimelineEntity[type='YARN_CONTAINER', id='container_1456425026132_0001_01_000001'] 2016-02-26 00:02:27,245 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_1456425026132_0001_01_000001 succeeded 2016-02-26 00:02:27,246 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1456425026132_0001_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS 2016-02-26 00:02:27,246 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1456425026132_0001_01_000001 2016-02-26 00:02:27,267 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=naga OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1456425026132_0001 CONTAINERID=container_1456425026132_0001_01_000001 2016-02-26 00:02:27,267 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1456425026132_0001_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE 2016-02-26 00:02:27,267 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_1456425026132_0001_01_000001 from application application_1456425026132_0001 2016-02-26 00:02:27,268 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_1456425026132_0001_01_000001 2016-02-26 00:02:27,268 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1456425026132_0001_01_000001 for log-aggregation 2016-02-26 00:02:27,268 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1456425026132_0001 2016-02-26 00:02:27,738 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1456425026132_0001_000001 (auth:SIMPLE) 2016-02-26 00:02:27,740 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Stopping container with container Id: container_1456425026132_0001_01_000001 2016-02-26 00:02:27,740 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=naga IP=127.0.0.1 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1456425026132_0001 CONTAINERID=container_1456425026132_0001_01_000001 2016-02-26 00:02:27,743 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1456425026132_0001_01_000001] 2016-02-26 00:02:27,746 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Application application_1456425026132_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP 2016-02-26 00:02:27,746 ERROR org.apache.hadoop.yarn.server.nodemanager.timelineservice.NMTimelinePublisher: Seems like event type is captured only in publishApplicationEvent method and not handled here. eventType: FINISH_APPLICATION 2016-02-26 00:02:27,747 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_STOP for appId application_1456425026132_0001 2016-02-26 00:02:27,750 INFO org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl: Stopping TimelineClient. 2016-02-26 00:02:27,750 INFO org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl: Timeline dispatcher thread was interrupted 2016-02-26 00:02:27,752 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Application application_1456425026132_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED 2016-02-26 00:02:27,752 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Application just finished : application_1456425026132_0001 2016-02-26 00:02:27,818 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1456425026132_0001_01_000002. Current good log dirs are /opt/install/hadoop-2.7.1/nmlogdir 2016-02-26 00:02:27,828 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1456425026132_0001_01_000003. Current good log dirs are /opt/install/hadoop-2.7.1/nmlogdir 2016-02-26 00:02:27,829 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1456425026132_0001_01_000001. Current good log dirs are /opt/install/hadoop-2.7.1/nmlogdir 2016-02-26 00:02:28,270 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1456425026132_0001 was removed 2016-02-26 00:39:03,879 ERROR org.apache.hadoop.hbase.client.AsyncProcess: Failed to get region location org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=36, exceptions: Fri Feb 26 00:39:03 IST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68065: row 'timelineservice.entity,naga!yarn_cluster!flow_1456425026132_1!�������!����M�����!YARN_CONTAINER!container_1456425026132_0001_01_000001,99999999999999' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=localhost,16201,1456365764939, seqNum=0 at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:264) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:215) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:56) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200) at org.apache.hadoop.hbase.client.ClientSmallReversedScanner.loadCache(ClientSmallReversedScanner.java:211) at org.apache.hadoop.hbase.client.ClientSmallReversedScanner.next(ClientSmallReversedScanner.java:185) at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1200) at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1109) at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:369) at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:320) at org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:206) at org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:183) at org.apache.hadoop.yarn.server.timelineservice.storage.common.BufferedMutatorDelegator.flush(BufferedMutatorDelegator.java:66) at org.apache.hadoop.yarn.server.timelineservice.storage.HBaseTimelineWriterImpl.flush(HBaseTimelineWriterImpl.java:457) at org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager$WriterFlushTask.run(TimelineCollectorManager.java:230) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68065: row 'timelineservice.entity,naga!yarn_cluster!flow_1456425026132_1!�������!����M�����!YARN_CONTAINER!container_1456425026132_0001_01_000001,99999999999999' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=localhost,16201,1456365764939, seqNum=0 at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:159) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:310) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:291) at java.util.concurrent.FutureTask.run(FutureTask.java:262) ... 3 more Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744) at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:495) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.setupConnection(RpcClientImpl.java:403) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.setupIOstreams(RpcClientImpl.java:709) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.writeRequest(RpcClientImpl.java:880) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.tracedWriteRequest(RpcClientImpl.java:849) at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1173) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:216) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:300) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:31889) at org.apache.hadoop.hbase.client.ClientSmallScanner$SmallScannerCallable.call(ClientSmallScanner.java:202) at org.apache.hadoop.hbase.client.ClientSmallScanner$SmallScannerCallable.call(ClientSmallScanner.java:181) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:126) ... 6 more 2016-02-26 01:09:19,799 ERROR org.apache.hadoop.yarn.server.nodemanager.NodeManager: RECEIVED SIGNAL 15: SIGTERM 2016-02-26 01:09:19,820 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Successfully Unregistered the Node localhost:34892 with ResourceManager. 2016-02-26 01:09:19,820 INFO org.apache.hadoop.ipc.Server: Stopping server on 8048 2016-02-26 01:09:19,821 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 8048 2016-02-26 01:09:19,821 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder 2016-02-26 01:09:19,824 INFO org.mortbay.log: Stopped SelectChannelConnector@0.0.0.0:8042 2016-02-26 01:09:19,925 INFO org.apache.hadoop.ipc.Server: Stopping server on 34892 2016-02-26 01:09:19,925 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder 2016-02-26 01:09:19,925 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 34892 2016-02-26 01:09:19,925 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService: org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService waiting for pending aggregation during exit 2016-02-26 01:09:19,926 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is interrupted. Exiting. 2016-02-26 01:09:19,934 INFO org.mortbay.log: Stopped SelectChannelConnector@0.0.0.0:0 2016-02-26 01:09:50,035 WARN org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: failed to stop the flusher task in time. will still proceed to close the writer. 2016-02-26 01:09:50,035 INFO org.apache.hadoop.yarn.server.timelineservice.storage.HBaseTimelineWriterImpl: closing the entity table