2017-08-22 04:29:23,497 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 04:29:23,500 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000006 by user hdfs 2017-08-22 04:29:23,500 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Creating a new application reference for app application_1501810184023_55949 2017-08-22 04:29:23,500 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Application application_1501810184023_55949 transitioned from NEW to INITING 2017-08-22 04:29:23,500 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Application application_1501810184023_55949 transitioned from INITING to RUNNING 2017-08-22 04:29:23,500 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000006 to application application_1501810184023_55949 2017-08-22 04:29:23,500 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000006 2017-08-22 04:29:23,500 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000006 transitioned from NEW to LOCALIZING 2017-08-22 04:29:23,500 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 04:29:23,500 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000006 2017-08-22 04:29:23,500 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 04:29:23,500 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 04:29:23,500 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://root/user/hdfs/.sparkStaging/application_1501810184023_55949/__spark_libs__9137571902600232529.zip transitioned from INIT to DOWNLOADING 2017-08-22 04:29:23,500 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://root/user/hdfs/.sparkStaging/application_1501810184023_55949/__spark_conf__.zip transitioned from INIT to DOWNLOADING 2017-08-22 04:29:23,500 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://root/user/hdfs/.sparkStaging/application_1501810184023_55949/hive-exec-2.1.1-patriot0.1.2.jar transitioned from INIT to DOWNLOADING 2017-08-22 04:29:23,500 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Created localizer for container_e24_1501810184023_55949_01_000006 2017-08-22 04:29:23,501 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Writing credentials to the nmPrivate file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/container_e24_1501810184023_55949_01_000006.tokens. Credentials list: 2017-08-22 04:29:26,188 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://root/user/hdfs/.sparkStaging/application_1501810184023_55949/__spark_libs__9137571902600232529.zip(->/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/filecache/229461/__spark_libs__9137571902600232529.zip) transitioned from DOWNLOADING to LOCALIZED 2017-08-22 04:29:26,190 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://root/user/hdfs/.sparkStaging/application_1501810184023_55949/__spark_conf__.zip(->/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/filecache/229462/__spark_conf__.zip) transitioned from DOWNLOADING to LOCALIZED 2017-08-22 04:29:26,307 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://root/user/hdfs/.sparkStaging/application_1501810184023_55949/hive-exec-2.1.1-patriot0.1.2.jar(->/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/filecache/229463/hive-exec-2.1.1-patriot0.1.2.jar) transitioned from DOWNLOADING to LOCALIZED 2017-08-22 04:29:26,307 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000006 transitioned from LOCALIZING to LOCALIZED 2017-08-22 04:29:26,318 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000006 transitioned from LOCALIZED to RUNNING 2017-08-22 04:29:26,318 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000006 2017-08-22 04:29:42,877 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=6} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-930c0cd8-1d31-4cdb-a244-f6ad4bf74bff], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 04:43:28,023 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 04:43:28,064 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000010 by user hdfs 2017-08-22 04:43:28,064 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000010 to application application_1501810184023_55949 2017-08-22 04:43:28,064 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000010 2017-08-22 04:43:28,064 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000010 transitioned from NEW to LOCALIZING 2017-08-22 04:43:28,064 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 04:43:28,064 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000010 2017-08-22 04:43:28,064 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 04:43:28,064 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 04:43:28,064 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000010 transitioned from LOCALIZING to LOCALIZED 2017-08-22 04:43:28,075 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000010 transitioned from LOCALIZED to RUNNING 2017-08-22 04:43:28,075 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000010 2017-08-22 04:43:44,049 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=9} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-bf8a19f5-e9ae-4269-a0ef-b27d0f9c17e7], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 04:43:55,071 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 04:43:55,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000011 by user hdfs 2017-08-22 04:43:55,110 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000011 2017-08-22 04:43:55,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000011 to application application_1501810184023_55949 2017-08-22 04:43:55,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000011 transitioned from NEW to LOCALIZING 2017-08-22 04:43:55,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 04:43:55,110 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000011 2017-08-22 04:43:55,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 04:43:55,110 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 04:43:55,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000011 transitioned from LOCALIZING to LOCALIZED 2017-08-22 04:43:55,124 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000011 transitioned from LOCALIZED to RUNNING 2017-08-22 04:43:55,124 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000011 2017-08-22 04:44:13,574 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=10} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-f3437e8d-9595-4898-8bda-92ebff3ada1d], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 04:55:28,108 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 04:55:28,116 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000022 by user hdfs 2017-08-22 04:55:28,116 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000022 to application application_1501810184023_55949 2017-08-22 04:55:28,116 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000022 2017-08-22 04:55:28,116 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000022 transitioned from NEW to LOCALIZING 2017-08-22 04:55:28,116 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 04:55:28,116 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000022 2017-08-22 04:55:28,116 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 04:55:28,116 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 04:55:28,116 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000022 transitioned from LOCALIZING to LOCALIZED 2017-08-22 04:55:28,132 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000022 transitioned from LOCALIZED to RUNNING 2017-08-22 04:55:28,132 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000022 2017-08-22 04:55:40,063 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 04:55:40,107 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000024 by user hdfs 2017-08-22 04:55:40,107 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000024 to application application_1501810184023_55949 2017-08-22 04:55:40,107 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000024 2017-08-22 04:55:40,107 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000024 transitioned from NEW to LOCALIZING 2017-08-22 04:55:40,107 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 04:55:40,107 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000024 2017-08-22 04:55:40,107 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 04:55:40,107 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 04:55:40,107 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000024 transitioned from LOCALIZING to LOCALIZED 2017-08-22 04:55:40,118 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000024 transitioned from LOCALIZED to RUNNING 2017-08-22 04:55:40,118 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000024 2017-08-22 04:55:40,770 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=20} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-279648e8-3fa7-461f-9a39-93514737e1c7], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 04:55:46,838 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 04:55:46,879 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000025 by user hdfs 2017-08-22 04:55:46,879 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000025 to application application_1501810184023_55949 2017-08-22 04:55:46,879 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000025 2017-08-22 04:55:46,879 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000025 transitioned from NEW to LOCALIZING 2017-08-22 04:55:46,879 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 04:55:46,879 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000025 2017-08-22 04:55:46,879 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 04:55:46,879 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 04:55:46,880 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000025 transitioned from LOCALIZING to LOCALIZED 2017-08-22 04:55:46,890 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000025 transitioned from LOCALIZED to RUNNING 2017-08-22 04:55:46,890 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000025 2017-08-22 04:55:52,926 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 04:55:53,012 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000026 by user hdfs 2017-08-22 04:55:53,012 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000026 to application application_1501810184023_55949 2017-08-22 04:55:53,012 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000026 2017-08-22 04:55:53,012 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000026 transitioned from NEW to LOCALIZING 2017-08-22 04:55:53,012 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 04:55:53,012 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000026 2017-08-22 04:55:53,012 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 04:55:53,012 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 04:55:53,012 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000026 transitioned from LOCALIZING to LOCALIZED 2017-08-22 04:55:53,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000026 transitioned from LOCALIZED to RUNNING 2017-08-22 04:55:53,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000026 2017-08-22 04:55:57,480 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=22} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-dd34ef34-c3c6-422e-a35b-30e97d22badf], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 04:55:59,066 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 04:55:59,070 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000028 by user hdfs 2017-08-22 04:55:59,070 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000028 to application application_1501810184023_55949 2017-08-22 04:55:59,071 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000028 2017-08-22 04:55:59,071 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000028 transitioned from NEW to LOCALIZING 2017-08-22 04:55:59,071 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 04:55:59,071 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000028 2017-08-22 04:55:59,071 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 04:55:59,071 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 04:55:59,071 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000028 transitioned from LOCALIZING to LOCALIZED 2017-08-22 04:55:59,081 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000028 transitioned from LOCALIZED to RUNNING 2017-08-22 04:55:59,081 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000028 2017-08-22 04:56:12,106 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=23} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-1c0d1706-4f66-42d5-9d2b-49a7f0ae4eb2], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 04:56:20,362 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 04:56:20,404 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000033 by user hdfs 2017-08-22 04:56:20,404 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000033 to application application_1501810184023_55949 2017-08-22 04:56:20,404 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000033 2017-08-22 04:56:20,404 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000033 transitioned from NEW to LOCALIZING 2017-08-22 04:56:20,404 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 04:56:20,404 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000033 2017-08-22 04:56:20,404 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 04:56:20,404 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 04:56:20,404 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000033 transitioned from LOCALIZING to LOCALIZED 2017-08-22 04:56:20,415 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000033 transitioned from LOCALIZED to RUNNING 2017-08-22 04:56:20,415 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000033 2017-08-22 04:56:22,536 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=24} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-ca3664dc-420d-4965-8eaa-33bd7e039547], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 04:56:23,534 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=26} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-6b6e31ea-5fa1-4199-9c55-dfe2ef34df93], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 04:56:38,772 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=31} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-881fab2c-fba4-4bb1-8dd9-5ab35a512df7], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 04:57:39,529 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000033 transitioned from RUNNING to KILLING 2017-08-22 04:57:39,529 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000033 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000033/container_e24_1501810184023_55949_01_000033.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000033, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000033, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000033/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000033/container_e24_1501810184023_55949_01_000033.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000033/container_e24_1501810184023_55949_01_000033.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000033/tasks] 2017-08-22 04:57:39,537 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000033 is : 143 2017-08-22 04:57:40,044 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000033 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 04:57:40,044 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000033 2017-08-22 04:57:40,044 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000033 2017-08-22 04:57:40,044 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000033 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 04:57:40,044 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000033 from application application_1501810184023_55949 2017-08-22 04:57:40,044 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000033 2017-08-22 04:57:40,044 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 04:57:40,044 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000033 2017-08-22 04:57:40,045 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_e24_1501810184023_55949_01_000033] 2017-08-22 04:57:46,916 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000010 transitioned from RUNNING to KILLING 2017-08-22 04:57:46,916 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000010 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000010/container_e24_1501810184023_55949_01_000010.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000010, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000010, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000010/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000010/container_e24_1501810184023_55949_01_000010.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000010/container_e24_1501810184023_55949_01_000010.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000010/tasks] 2017-08-22 04:57:46,924 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000010 is : 143 2017-08-22 04:57:47,954 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000010 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 04:57:47,954 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000010 2017-08-22 04:57:47,954 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000010 2017-08-22 04:57:47,954 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000010 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 04:57:47,954 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000010 from application application_1501810184023_55949 2017-08-22 04:57:47,954 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000010 2017-08-22 04:57:47,954 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 04:57:47,954 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000010 2017-08-22 04:57:47,955 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_e24_1501810184023_55949_01_000010] 2017-08-22 04:59:24,376 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000011 transitioned from RUNNING to KILLING 2017-08-22 04:59:24,376 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000011 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000011/container_e24_1501810184023_55949_01_000011.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000011, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000011, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000011/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000011/container_e24_1501810184023_55949_01_000011.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000011/container_e24_1501810184023_55949_01_000011.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000011/tasks] 2017-08-22 04:59:24,383 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000011 is : 143 2017-08-22 04:59:25,333 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000011 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 04:59:25,333 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000011 2017-08-22 04:59:25,333 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000011 2017-08-22 04:59:25,333 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000011 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 04:59:25,333 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000011 from application application_1501810184023_55949 2017-08-22 04:59:25,333 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000011 2017-08-22 04:59:25,333 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 04:59:25,333 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000011 2017-08-22 04:59:25,335 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_e24_1501810184023_55949_01_000011, container_e24_1501810184023_55899_01_000233] 2017-08-22 05:01:18,178 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000022 transitioned from RUNNING to KILLING 2017-08-22 05:01:18,178 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000022 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000022/container_e24_1501810184023_55949_01_000022.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000022, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000022, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000022/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000022/container_e24_1501810184023_55949_01_000022.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000022/container_e24_1501810184023_55949_01_000022.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000022/tasks] 2017-08-22 05:01:18,192 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000022 is : 143 2017-08-22 05:01:19,260 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000022 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:01:19,260 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000022 2017-08-22 05:01:19,260 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000022 2017-08-22 05:01:19,260 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000022 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:01:19,260 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000022 from application application_1501810184023_55949 2017-08-22 05:01:19,260 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000022 2017-08-22 05:01:19,260 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:01:19,260 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000022 2017-08-22 05:01:19,261 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_e24_1501810184023_55949_01_000022] 2017-08-22 05:02:38,054 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000006 transitioned from RUNNING to KILLING 2017-08-22 05:02:38,054 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000006 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000006/container_e24_1501810184023_55949_01_000006.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000006, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000006, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000006/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000006/container_e24_1501810184023_55949_01_000006.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000006/container_e24_1501810184023_55949_01_000006.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000006/tasks] 2017-08-22 05:02:38,062 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000006 is : 143 2017-08-22 05:02:39,389 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:02:39,390 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000006 2017-08-22 05:02:39,390 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000006 2017-08-22 05:02:39,390 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:02:39,390 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000006 from application application_1501810184023_55949 2017-08-22 05:02:39,390 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000006 2017-08-22 05:02:39,390 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:02:39,390 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000006 2017-08-22 05:02:39,391 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_e24_1501810184023_56043_01_000045, container_e24_1501810184023_55949_01_000006] 2017-08-22 05:03:58,248 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000025 transitioned from RUNNING to KILLING 2017-08-22 05:03:58,248 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000025 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000025/container_e24_1501810184023_55949_01_000025.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000025, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000025, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000025/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000025/container_e24_1501810184023_55949_01_000025.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000025/container_e24_1501810184023_55949_01_000025.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000025/tasks] 2017-08-22 05:03:58,255 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000025 is : 143 2017-08-22 05:04:00,063 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000025 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:04:00,063 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000025 2017-08-22 05:04:00,063 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000025 2017-08-22 05:04:00,064 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000025 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:04:00,064 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000025 from application application_1501810184023_55949 2017-08-22 05:04:00,064 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000025 2017-08-22 05:04:00,064 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:04:00,064 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000025 2017-08-22 05:04:00,065 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_e24_1501810184023_55949_01_000025] 2017-08-22 05:04:05,708 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000026 transitioned from RUNNING to KILLING 2017-08-22 05:04:05,708 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000026 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000026/container_e24_1501810184023_55949_01_000026.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000026, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000026, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000026/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000026/container_e24_1501810184023_55949_01_000026.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000026/container_e24_1501810184023_55949_01_000026.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000026/tasks] 2017-08-22 05:04:05,716 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000026 is : 143 2017-08-22 05:04:06,805 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000026 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:04:06,805 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000026 2017-08-22 05:04:06,805 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000026 2017-08-22 05:04:06,805 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000026 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:04:06,805 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000026 from application application_1501810184023_55949 2017-08-22 05:04:06,805 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000026 2017-08-22 05:04:06,805 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:04:06,805 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000026 2017-08-22 05:04:06,806 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_e24_1501810184023_55949_01_000026] 2017-08-22 05:04:19,887 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:04:19,894 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000035 by user hdfs 2017-08-22 05:04:19,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000035 to application application_1501810184023_55949 2017-08-22 05:04:19,895 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000035 2017-08-22 05:04:19,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000035 transitioned from NEW to LOCALIZING 2017-08-22 05:04:19,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:04:19,895 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000035 2017-08-22 05:04:19,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:04:19,895 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:04:19,895 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000035 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:04:19,907 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000035 transitioned from LOCALIZED to RUNNING 2017-08-22 05:04:19,907 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000035 2017-08-22 05:04:21,166 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:04:21,202 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000037 by user hdfs 2017-08-22 05:04:21,202 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000037 to application application_1501810184023_55949 2017-08-22 05:04:21,202 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000037 2017-08-22 05:04:21,202 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000037 transitioned from NEW to LOCALIZING 2017-08-22 05:04:21,202 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:04:21,202 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000037 2017-08-22 05:04:21,202 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:04:21,202 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:04:21,203 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000037 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:04:21,217 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000037 transitioned from LOCALIZED to RUNNING 2017-08-22 05:04:21,217 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000037 2017-08-22 05:04:22,071 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:04:22,120 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000040 by user hdfs 2017-08-22 05:04:22,120 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000040 to application application_1501810184023_55949 2017-08-22 05:04:22,120 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000040 2017-08-22 05:04:22,120 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000040 transitioned from NEW to LOCALIZING 2017-08-22 05:04:22,120 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:04:22,120 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000040 2017-08-22 05:04:22,120 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:04:22,120 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:04:22,120 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000040 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:04:22,131 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000040 transitioned from LOCALIZED to RUNNING 2017-08-22 05:04:22,131 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000040 2017-08-22 05:04:22,789 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:04:22,824 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000041 by user hdfs 2017-08-22 05:04:22,825 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000041 2017-08-22 05:04:22,825 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000041 to application application_1501810184023_55949 2017-08-22 05:04:22,825 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000041 transitioned from NEW to LOCALIZING 2017-08-22 05:04:22,825 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:04:22,825 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000041 2017-08-22 05:04:22,825 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:04:22,825 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:04:22,825 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000041 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:04:22,837 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000041 transitioned from LOCALIZED to RUNNING 2017-08-22 05:04:22,837 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000041 2017-08-22 05:04:23,881 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:04:23,925 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:04:23,928 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000045 by user hdfs 2017-08-22 05:04:23,928 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000045 to application application_1501810184023_55949 2017-08-22 05:04:23,928 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000045 2017-08-22 05:04:23,928 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000045 transitioned from NEW to LOCALIZING 2017-08-22 05:04:23,928 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:04:23,928 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000045 2017-08-22 05:04:23,928 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:04:23,928 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:04:23,928 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000045 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:04:23,939 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000045 transitioned from LOCALIZED to RUNNING 2017-08-22 05:04:23,939 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000045 2017-08-22 05:04:23,967 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000044 by user hdfs 2017-08-22 05:04:23,967 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000044 2017-08-22 05:04:23,968 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000044 to application application_1501810184023_55949 2017-08-22 05:04:23,968 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000044 transitioned from NEW to LOCALIZING 2017-08-22 05:04:23,968 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:04:23,968 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000044 2017-08-22 05:04:23,968 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:04:23,968 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:04:23,968 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000044 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:04:23,979 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000044 transitioned from LOCALIZED to RUNNING 2017-08-22 05:04:23,979 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000044 2017-08-22 05:04:25,495 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:04:25,498 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000046 by user hdfs 2017-08-22 05:04:25,498 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000046 to application application_1501810184023_55949 2017-08-22 05:04:25,498 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000046 2017-08-22 05:04:25,498 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000046 transitioned from NEW to LOCALIZING 2017-08-22 05:04:25,498 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:04:25,498 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000046 2017-08-22 05:04:25,498 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:04:25,498 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:04:25,498 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000046 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:04:25,509 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000046 transitioned from LOCALIZED to RUNNING 2017-08-22 05:04:25,509 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000046 2017-08-22 05:04:32,877 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=33} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-cc3f1406-d8a2-4bf5-a276-8f7aed75c513], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:04:35,884 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:04:35,925 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000049 by user hdfs 2017-08-22 05:04:35,925 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000049 to application application_1501810184023_55949 2017-08-22 05:04:35,925 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000049 2017-08-22 05:04:35,925 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000049 transitioned from NEW to LOCALIZING 2017-08-22 05:04:35,925 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:04:35,925 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000049 2017-08-22 05:04:35,925 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:04:35,926 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:04:35,926 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000049 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:04:35,936 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000049 transitioned from LOCALIZED to RUNNING 2017-08-22 05:04:35,936 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000049 2017-08-22 05:04:39,020 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:04:39,063 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000051 by user hdfs 2017-08-22 05:04:39,064 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000051 2017-08-22 05:04:39,064 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000051 to application application_1501810184023_55949 2017-08-22 05:04:39,064 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000051 transitioned from NEW to LOCALIZING 2017-08-22 05:04:39,064 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:04:39,064 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000051 2017-08-22 05:04:39,064 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:04:39,064 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:04:39,064 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000051 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:04:39,077 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000051 transitioned from LOCALIZED to RUNNING 2017-08-22 05:04:39,077 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000051 2017-08-22 05:04:39,304 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:04:39,353 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000054 by user hdfs 2017-08-22 05:04:39,353 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000054 to application application_1501810184023_55949 2017-08-22 05:04:39,353 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000054 2017-08-22 05:04:39,353 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000054 transitioned from NEW to LOCALIZING 2017-08-22 05:04:39,353 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:04:39,353 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000054 2017-08-22 05:04:39,353 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:04:39,353 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:04:39,353 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000054 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:04:39,368 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000054 transitioned from LOCALIZED to RUNNING 2017-08-22 05:04:39,368 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000054 2017-08-22 05:04:42,003 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=35} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-3481b1f7-19a5-471a-9bc8-d25c619c236d], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:04:42,146 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=39} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-a9afe813-fff6-448b-8879-118085b8a24e], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:04:43,158 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=43} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-2e9923b1-281c-4a9d-8069-6c5430bd5fc3], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:04:44,916 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=38} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-2ae72383-5f72-4002-84a7-e6335b8c2b6c], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:04:45,014 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:04:45,021 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000057 by user hdfs 2017-08-22 05:04:45,022 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000057 to application application_1501810184023_55949 2017-08-22 05:04:45,022 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000057 2017-08-22 05:04:45,022 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000057 transitioned from NEW to LOCALIZING 2017-08-22 05:04:45,022 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:04:45,022 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000057 2017-08-22 05:04:45,022 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:04:45,022 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:04:45,022 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000057 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:04:45,033 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000057 transitioned from LOCALIZED to RUNNING 2017-08-22 05:04:45,033 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000057 2017-08-22 05:04:45,915 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=42} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-91dd2e1a-6bc2-4429-8b71-2f4240987159], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:04:48,014 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=44} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-90a4bf02-0b6a-4ec7-a190-654b16f1bd1c], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:04:52,105 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=52} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-d58df218-3b44-404a-a086-2f41dafce79d], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:04:55,584 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=47} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-ba2c605e-89d8-4f7c-b42c-6ed4ba6bf4ea], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:04:57,075 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:04:57,115 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000062 by user hdfs 2017-08-22 05:04:57,115 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000062 to application application_1501810184023_55949 2017-08-22 05:04:57,115 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000062 2017-08-22 05:04:57,115 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000062 transitioned from NEW to LOCALIZING 2017-08-22 05:04:57,115 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:04:57,115 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000062 2017-08-22 05:04:57,115 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:04:57,115 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:04:57,115 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000062 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:04:57,126 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000062 transitioned from LOCALIZED to RUNNING 2017-08-22 05:04:57,126 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000062 2017-08-22 05:04:59,198 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=49} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-7f496b03-1489-4058-8f65-533807bb17b4], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:05:00,670 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=55} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-83fc0702-ac40-4743-812a-7d488e92004e], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:05:03,074 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:05:03,112 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000065 by user hdfs 2017-08-22 05:05:03,112 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000065 to application application_1501810184023_55949 2017-08-22 05:05:03,112 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000065 2017-08-22 05:05:03,112 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000065 transitioned from NEW to LOCALIZING 2017-08-22 05:05:03,112 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:05:03,112 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000065 2017-08-22 05:05:03,112 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:05:03,112 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:05:03,112 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000065 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:05:03,124 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000065 transitioned from LOCALIZED to RUNNING 2017-08-22 05:05:03,125 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000065 2017-08-22 05:05:17,729 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=60} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-53dcb4ea-ba5d-4b8b-859b-805b9303a149], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:05:18,211 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:05:18,257 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000072 by user hdfs 2017-08-22 05:05:18,258 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000072 2017-08-22 05:05:18,258 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000072 to application application_1501810184023_55949 2017-08-22 05:05:18,258 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000072 transitioned from NEW to LOCALIZING 2017-08-22 05:05:18,258 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:05:18,258 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000072 2017-08-22 05:05:18,258 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:05:18,258 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:05:18,258 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000072 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:05:18,269 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000072 transitioned from LOCALIZED to RUNNING 2017-08-22 05:05:18,269 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000072 2017-08-22 05:05:23,051 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=63} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-c0cd0df9-b355-4209-b6aa-b549a1fa36eb], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:05:38,382 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=70} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-2de6eda7-e0ef-4dff-b4d3-05c74bc63d57], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:07:12,583 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:07:12,589 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000074 by user hdfs 2017-08-22 05:07:12,589 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000074 2017-08-22 05:07:12,589 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000074 to application application_1501810184023_55949 2017-08-22 05:07:12,589 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000074 transitioned from NEW to LOCALIZING 2017-08-22 05:07:12,589 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:07:12,589 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000074 2017-08-22 05:07:12,589 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:07:12,589 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:07:12,589 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000074 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:07:12,600 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000074 transitioned from LOCALIZED to RUNNING 2017-08-22 05:07:12,600 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000074 2017-08-22 05:07:15,641 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:07:15,681 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:07:15,682 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:07:15,726 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000080 by user hdfs 2017-08-22 05:07:15,726 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000080 to application application_1501810184023_55949 2017-08-22 05:07:15,726 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000080 2017-08-22 05:07:15,726 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000080 transitioned from NEW to LOCALIZING 2017-08-22 05:07:15,726 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:07:15,726 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000080 2017-08-22 05:07:15,726 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:07:15,726 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:07:15,726 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000080 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:07:15,728 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000079 by user hdfs 2017-08-22 05:07:15,728 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000079 2017-08-22 05:07:15,728 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000079 to application application_1501810184023_55949 2017-08-22 05:07:15,728 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000079 transitioned from NEW to LOCALIZING 2017-08-22 05:07:15,728 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:07:15,728 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000079 2017-08-22 05:07:15,728 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:07:15,728 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:07:15,728 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000079 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:07:15,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000078 by user hdfs 2017-08-22 05:07:15,729 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000078 2017-08-22 05:07:15,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000078 to application application_1501810184023_55949 2017-08-22 05:07:15,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000078 transitioned from NEW to LOCALIZING 2017-08-22 05:07:15,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:07:15,729 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000078 2017-08-22 05:07:15,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:07:15,729 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:07:15,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000078 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:07:15,741 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000080 transitioned from LOCALIZED to RUNNING 2017-08-22 05:07:15,741 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000080 2017-08-22 05:07:15,741 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000079 transitioned from LOCALIZED to RUNNING 2017-08-22 05:07:15,741 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000079 2017-08-22 05:07:15,745 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000078 transitioned from LOCALIZED to RUNNING 2017-08-22 05:07:15,745 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000078 2017-08-22 05:07:27,777 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:07:27,781 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000084 by user hdfs 2017-08-22 05:07:27,782 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000084 to application application_1501810184023_55949 2017-08-22 05:07:27,782 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000084 2017-08-22 05:07:27,782 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000084 transitioned from NEW to LOCALIZING 2017-08-22 05:07:27,782 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:07:27,782 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000084 2017-08-22 05:07:27,782 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:07:27,782 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:07:27,782 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000084 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:07:27,883 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000084 transitioned from LOCALIZED to RUNNING 2017-08-22 05:07:27,883 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000084 2017-08-22 05:07:34,253 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=76} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-12847eb3-c95b-4065-9137-4858704f41be], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:07:34,304 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=75} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-6c5e260f-d3c7-4af6-91c1-168c73343f2d], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:07:36,821 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:07:36,825 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000089 by user hdfs 2017-08-22 05:07:36,825 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000089 to application application_1501810184023_55949 2017-08-22 05:07:36,825 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000089 2017-08-22 05:07:36,825 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000089 transitioned from NEW to LOCALIZING 2017-08-22 05:07:36,825 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:07:36,825 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000089 2017-08-22 05:07:36,825 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:07:36,825 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:07:36,825 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000089 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:07:36,828 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=72} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-f6cfe045-12c3-41d6-b77e-aa5200daeb6a], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:07:36,839 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000089 transitioned from LOCALIZED to RUNNING 2017-08-22 05:07:36,839 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000089 2017-08-22 05:07:39,868 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:07:39,876 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000090 by user hdfs 2017-08-22 05:07:39,876 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000090 2017-08-22 05:07:39,883 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000090 to application application_1501810184023_55949 2017-08-22 05:07:39,883 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000090 transitioned from NEW to LOCALIZING 2017-08-22 05:07:39,883 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:07:39,883 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000090 2017-08-22 05:07:39,883 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:07:39,883 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:07:39,883 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000090 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:07:39,893 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000090 transitioned from LOCALIZED to RUNNING 2017-08-22 05:07:39,893 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000090 2017-08-22 05:07:41,246 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=77} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-f4e3a586-8817-45ea-a197-9fdbb3d91946], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:07:42,876 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:07:42,878 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000093 by user hdfs 2017-08-22 05:07:42,878 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000093 to application application_1501810184023_55949 2017-08-22 05:07:42,878 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000093 2017-08-22 05:07:42,879 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000093 transitioned from NEW to LOCALIZING 2017-08-22 05:07:42,879 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:07:42,879 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000093 2017-08-22 05:07:42,879 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:07:42,879 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:07:42,879 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000093 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:07:42,889 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000093 transitioned from LOCALIZED to RUNNING 2017-08-22 05:07:42,889 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000093 2017-08-22 05:07:45,917 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:07:45,921 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000094 by user hdfs 2017-08-22 05:07:45,921 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000094 2017-08-22 05:07:45,922 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000094 to application application_1501810184023_55949 2017-08-22 05:07:45,922 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000094 transitioned from NEW to LOCALIZING 2017-08-22 05:07:45,922 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:07:45,922 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000094 2017-08-22 05:07:45,922 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:07:45,922 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:07:45,922 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000094 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:07:45,935 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000094 transitioned from LOCALIZED to RUNNING 2017-08-22 05:07:45,935 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000094 2017-08-22 05:07:47,255 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=81} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-28a31574-61ae-459f-be3a-8608892246d7], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:07:51,968 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:07:52,012 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000095 by user hdfs 2017-08-22 05:07:52,013 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000095 to application application_1501810184023_55949 2017-08-22 05:07:52,013 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000095 2017-08-22 05:07:52,013 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000095 transitioned from NEW to LOCALIZING 2017-08-22 05:07:52,013 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:07:52,013 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000095 2017-08-22 05:07:52,013 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:07:52,013 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:07:52,013 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000095 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:07:52,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000095 transitioned from LOCALIZED to RUNNING 2017-08-22 05:07:52,026 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000095 2017-08-22 05:07:54,193 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=85} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-fbc87680-4df7-498e-bf6d-456a5aea4fc9], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:07:57,976 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:07:58,017 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000098 by user hdfs 2017-08-22 05:07:58,018 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000098 to application application_1501810184023_55949 2017-08-22 05:07:58,018 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000098 2017-08-22 05:07:58,018 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000098 transitioned from NEW to LOCALIZING 2017-08-22 05:07:58,018 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:07:58,018 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000098 2017-08-22 05:07:58,018 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:07:58,018 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:07:58,018 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000098 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:07:58,029 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000098 transitioned from LOCALIZED to RUNNING 2017-08-22 05:07:58,029 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000098 2017-08-22 05:08:00,483 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=86} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-c352c1ad-15dc-456b-8b62-5b83b9950494], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:08:00,824 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=89} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-d79912b2-924e-4608-9f1e-8331d2bc12ea], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:08:04,012 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:08:04,015 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000102 by user hdfs 2017-08-22 05:08:04,016 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000102 2017-08-22 05:08:04,016 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000102 to application application_1501810184023_55949 2017-08-22 05:08:04,016 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000102 transitioned from NEW to LOCALIZING 2017-08-22 05:08:04,016 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:08:04,016 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000102 2017-08-22 05:08:04,016 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:08:04,016 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:08:04,016 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000102 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:08:04,028 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000102 transitioned from LOCALIZED to RUNNING 2017-08-22 05:08:04,028 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000102 2017-08-22 05:08:05,112 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=90} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-cec0b810-0fe7-4777-a202-c13f8a091ffb], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:08:16,293 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=91} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-0095d26c-c134-48b4-82a6-e8ae02f0189c], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:08:16,635 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=94} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-557d0f39-67d2-491a-9307-12fc1d724380], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:08:26,622 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=98} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-0c0c4bb9-ef5e-4ca1-8d23-ce5cd58d0a75], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:08:46,258 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:08:46,307 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000112 by user hdfs 2017-08-22 05:08:46,307 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000112 to application application_1501810184023_55949 2017-08-22 05:08:46,307 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000112 2017-08-22 05:08:46,307 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000112 transitioned from NEW to LOCALIZING 2017-08-22 05:08:46,307 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:08:46,307 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000112 2017-08-22 05:08:46,307 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:08:46,307 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:08:46,307 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000112 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:08:46,317 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000112 transitioned from LOCALIZED to RUNNING 2017-08-22 05:08:46,317 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000112 2017-08-22 05:08:52,348 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:08:52,352 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:08:52,445 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000120 by user hdfs 2017-08-22 05:08:52,445 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000120 2017-08-22 05:08:52,445 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000120 to application application_1501810184023_55949 2017-08-22 05:08:52,445 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000120 transitioned from NEW to LOCALIZING 2017-08-22 05:08:52,445 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:08:52,445 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000120 2017-08-22 05:08:52,445 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:08:52,445 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:08:52,445 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000120 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:08:52,447 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000123 by user hdfs 2017-08-22 05:08:52,447 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000123 to application application_1501810184023_55949 2017-08-22 05:08:52,447 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000123 2017-08-22 05:08:52,447 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000123 transitioned from NEW to LOCALIZING 2017-08-22 05:08:52,447 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:08:52,447 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000123 2017-08-22 05:08:52,447 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:08:52,447 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:08:52,447 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000123 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:08:52,456 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000120 transitioned from LOCALIZED to RUNNING 2017-08-22 05:08:52,456 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000120 2017-08-22 05:08:52,457 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000123 transitioned from LOCALIZED to RUNNING 2017-08-22 05:08:52,457 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000123 2017-08-22 05:08:55,402 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:08:55,404 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:08:55,455 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000127 by user hdfs 2017-08-22 05:08:55,455 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000127 to application application_1501810184023_55949 2017-08-22 05:08:55,455 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000127 2017-08-22 05:08:55,455 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000127 transitioned from NEW to LOCALIZING 2017-08-22 05:08:55,455 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:08:55,455 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000127 2017-08-22 05:08:55,455 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:08:55,455 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:08:55,455 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000127 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:08:55,466 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000127 transitioned from LOCALIZED to RUNNING 2017-08-22 05:08:55,466 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000127 2017-08-22 05:08:55,489 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000129 by user hdfs 2017-08-22 05:08:55,490 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000129 to application application_1501810184023_55949 2017-08-22 05:08:55,490 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000129 2017-08-22 05:08:55,490 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000129 transitioned from NEW to LOCALIZING 2017-08-22 05:08:55,490 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:08:55,490 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000129 2017-08-22 05:08:55,490 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:08:55,490 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:08:55,490 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000129 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:08:55,500 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000129 transitioned from LOCALIZED to RUNNING 2017-08-22 05:08:55,500 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000129 2017-08-22 05:08:58,399 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:08:58,400 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000133 by user hdfs 2017-08-22 05:08:58,400 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000133 to application application_1501810184023_55949 2017-08-22 05:08:58,400 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000133 2017-08-22 05:08:58,400 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000133 transitioned from NEW to LOCALIZING 2017-08-22 05:08:58,400 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:08:58,400 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000133 2017-08-22 05:08:58,400 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:08:58,400 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:08:58,400 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000133 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:08:58,411 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000133 transitioned from LOCALIZED to RUNNING 2017-08-22 05:08:58,411 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000133 2017-08-22 05:09:01,430 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:09:01,529 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000137 by user hdfs 2017-08-22 05:09:01,529 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000137 2017-08-22 05:09:01,529 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000137 to application application_1501810184023_55949 2017-08-22 05:09:01,529 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000137 transitioned from NEW to LOCALIZING 2017-08-22 05:09:01,529 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:09:01,529 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000137 2017-08-22 05:09:01,529 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:09:01,529 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:09:01,529 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000137 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:09:01,544 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:09:01,547 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000137 transitioned from LOCALIZED to RUNNING 2017-08-22 05:09:01,547 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000137 2017-08-22 05:09:01,553 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000140 by user hdfs 2017-08-22 05:09:01,554 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000140 to application application_1501810184023_55949 2017-08-22 05:09:01,554 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000140 2017-08-22 05:09:01,554 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000140 transitioned from NEW to LOCALIZING 2017-08-22 05:09:01,554 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:09:01,554 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000140 2017-08-22 05:09:01,554 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:09:01,554 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:09:01,554 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000140 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:09:01,564 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000140 transitioned from LOCALIZED to RUNNING 2017-08-22 05:09:01,564 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000140 2017-08-22 05:09:08,397 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=108} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-238f4e5d-7858-43dc-a54e-194e04c98979], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:09:10,298 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=125} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-53ee8251-fac1-4f62-82c2-5e970f0d86ec], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:09:10,397 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:09:10,397 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1501810184023_55949_000001 (auth:SIMPLE) 2017-08-22 05:09:10,402 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000148 by user hdfs 2017-08-22 05:09:10,402 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000148 2017-08-22 05:09:10,402 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000148 to application application_1501810184023_55949 2017-08-22 05:09:10,402 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000148 transitioned from NEW to LOCALIZING 2017-08-22 05:09:10,402 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_e24_1501810184023_55949_01_000149 by user hdfs 2017-08-22 05:09:10,402 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:09:10,402 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000148 2017-08-22 05:09:10,402 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:09:10,402 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:09:10,402 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000148 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:09:10,402 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs IP= OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000149 2017-08-22 05:09:10,402 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Adding container_e24_1501810184023_55949_01_000149 to application application_1501810184023_55949 2017-08-22 05:09:10,403 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000149 transitioned from NEW to LOCALIZING 2017-08-22 05:09:10,403 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1501810184023_55949 2017-08-22 05:09:10,403 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing container container_e24_1501810184023_55949_01_000149 2017-08-22 05:09:10,403 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_INIT for appId application_1501810184023_55949 2017-08-22 05:09:10,403 INFO org.apache.spark.network.yarn.YarnShuffleService: Initializing application application_1501810184023_55949 2017-08-22 05:09:10,403 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000149 transitioned from LOCALIZING to LOCALIZED 2017-08-22 05:09:10,414 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000149 transitioned from LOCALIZED to RUNNING 2017-08-22 05:09:10,414 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000148 transitioned from LOCALIZED to RUNNING 2017-08-22 05:09:10,414 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000149 2017-08-22 05:09:10,414 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Starting resource-monitoring for container_e24_1501810184023_55949_01_000148 2017-08-22 05:09:11,143 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=116} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-a2730abb-9517-461e-bedf-d9a2dcef373f], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:09:11,205 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=119} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-592af4aa-3c89-4081-8746-29b99f2220b1], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:09:11,953 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=123} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-975bcce0-84b2-4590-880b-bf182d76e319], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:09:13,582 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=136} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-b4f01347-4b51-4b35-8146-2aa840084c2b], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:09:17,587 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=129} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-251c3a99-cd85-442a-8945-52c344c0d861], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:09:24,096 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=133} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-5a8bc187-abcf-482d-9da5-e8c4647d4731], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:09:26,153 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=144} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-0cda6a44-c64a-46c0-9ee0-b2ee02076f4a], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:09:28,491 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Registered executor AppExecId{appId=application_1501810184023_55949, execId=145} with ExecutorShuffleInfo{localDirs=[/share/tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/blockmgr-ce82cb63-5998-4227-b85e-77f1c633db43], subDirsPerLocalDir=64, shuffleManager=org.apache.spark.shuffle.sort.SortShuffleManager} 2017-08-22 05:14:31,286 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000057 transitioned from RUNNING to KILLING 2017-08-22 05:14:31,286 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000057 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000057/container_e24_1501810184023_55949_01_000057.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000057, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000057, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000057/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000057/container_e24_1501810184023_55949_01_000057.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000057/container_e24_1501810184023_55949_01_000057.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000057/tasks] 2017-08-22 05:14:31,293 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000057 is : 143 2017-08-22 05:14:31,988 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000074 transitioned from RUNNING to KILLING 2017-08-22 05:14:31,988 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000074 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000074/container_e24_1501810184023_55949_01_000074.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000074, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000074, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000074/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000074/container_e24_1501810184023_55949_01_000074.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000074/container_e24_1501810184023_55949_01_000074.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000074/tasks] 2017-08-22 05:14:32,005 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000074 is : 143 2017-08-22 05:14:32,178 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000057 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:14:32,178 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000057 2017-08-22 05:14:32,179 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000057 2017-08-22 05:14:32,179 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000057 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:14:32,179 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000057 from application application_1501810184023_55949 2017-08-22 05:14:32,179 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000057 2017-08-22 05:14:32,179 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:14:32,179 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000057 2017-08-22 05:14:32,180 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_e24_1501810184023_55949_01_000057] 2017-08-22 05:14:32,669 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000074 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:14:32,669 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000074 2017-08-22 05:14:32,669 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000074 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:14:32,670 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000074 from application application_1501810184023_55949 2017-08-22 05:14:32,670 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000074 2017-08-22 05:14:32,670 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000074 2017-08-22 05:14:32,670 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:14:32,670 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000074 2017-08-22 05:14:32,671 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_e24_1501810184023_55949_01_000074] 2017-08-22 05:14:33,672 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000062 transitioned from RUNNING to KILLING 2017-08-22 05:14:33,672 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000062 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000062/container_e24_1501810184023_55949_01_000062.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000062, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000062, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000062/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000062/container_e24_1501810184023_55949_01_000062.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000062/container_e24_1501810184023_55949_01_000062.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000062/tasks] 2017-08-22 05:14:33,687 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000062 is : 143 2017-08-22 05:14:34,499 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000062 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:14:34,499 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000062 2017-08-22 05:14:34,499 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000062 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:14:34,499 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000062 from application application_1501810184023_55949 2017-08-22 05:14:34,499 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000062 2017-08-22 05:14:34,499 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000062 2017-08-22 05:14:34,499 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:14:34,499 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000062 2017-08-22 05:14:34,500 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_e24_1501810184023_55949_01_000062] 2017-08-22 05:14:39,506 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000102 transitioned from RUNNING to KILLING 2017-08-22 05:14:39,506 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000102 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000102/container_e24_1501810184023_55949_01_000102.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000102, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000102, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000102/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000102/container_e24_1501810184023_55949_01_000102.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000102/container_e24_1501810184023_55949_01_000102.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000102/tasks] 2017-08-22 05:14:39,524 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000102 is : 143 2017-08-22 05:14:40,329 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000102 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:14:40,330 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000102 2017-08-22 05:14:40,330 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000102 2017-08-22 05:14:40,330 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000102 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:14:40,330 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000102 from application application_1501810184023_55949 2017-08-22 05:14:40,330 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000102 2017-08-22 05:14:40,330 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:14:40,330 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000102 2017-08-22 05:14:40,331 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_e24_1501810184023_55949_01_000102] 2017-08-22 05:14:41,332 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000094 transitioned from RUNNING to KILLING 2017-08-22 05:14:41,332 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000098 transitioned from RUNNING to KILLING 2017-08-22 05:14:41,332 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000094 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000094/container_e24_1501810184023_55949_01_000094.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000094, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000094, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000094/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000094/container_e24_1501810184023_55949_01_000094.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000094/container_e24_1501810184023_55949_01_000094.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000094/tasks] 2017-08-22 05:14:41,338 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000094 is : 143 2017-08-22 05:14:41,355 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000098 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000098/container_e24_1501810184023_55949_01_000098.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000098, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000098, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000098/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000098/container_e24_1501810184023_55949_01_000098.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000098/container_e24_1501810184023_55949_01_000098.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000098/tasks] 2017-08-22 05:14:41,362 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000098 is : 143 2017-08-22 05:14:42,073 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000094 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:14:42,073 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000094 2017-08-22 05:14:42,073 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000094 2017-08-22 05:14:42,073 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000094 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:14:42,073 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000094 from application application_1501810184023_55949 2017-08-22 05:14:42,073 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000094 2017-08-22 05:14:42,073 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:14:42,073 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000094 2017-08-22 05:14:42,074 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_e24_1501810184023_55949_01_000094] 2017-08-22 05:14:42,274 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000098 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:14:42,274 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000098 2017-08-22 05:14:42,274 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000098 2017-08-22 05:14:42,274 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000098 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:14:42,274 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000098 from application application_1501810184023_55949 2017-08-22 05:14:42,274 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000098 2017-08-22 05:14:42,274 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:14:42,274 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000098 2017-08-22 05:14:42,275 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_e24_1501810184023_55949_01_000098] 2017-08-22 05:14:49,916 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000089 transitioned from RUNNING to KILLING 2017-08-22 05:14:49,916 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000089 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000089/container_e24_1501810184023_55949_01_000089.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000089, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000089, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000089/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000089/container_e24_1501810184023_55949_01_000089.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000089/container_e24_1501810184023_55949_01_000089.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000089/tasks] 2017-08-22 05:14:49,924 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000089 is : 143 2017-08-22 05:14:50,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000089 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:14:50,609 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000089 2017-08-22 05:14:50,609 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000089 2017-08-22 05:14:50,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000089 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:14:50,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000089 from application application_1501810184023_55949 2017-08-22 05:14:50,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000089 2017-08-22 05:14:50,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:14:50,609 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000089 2017-08-22 05:14:50,610 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_e24_1501810184023_55949_01_000089] 2017-08-22 05:15:00,590 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000129 transitioned from RUNNING to KILLING 2017-08-22 05:15:00,590 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000129 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000129/container_e24_1501810184023_55949_01_000129.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000129, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000129, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000129/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000129/container_e24_1501810184023_55949_01_000129.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000129/container_e24_1501810184023_55949_01_000129.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000129/tasks] 2017-08-22 05:15:00,619 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000129 is : 143 2017-08-22 05:15:01,992 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000129 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:15:01,992 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000129 2017-08-22 05:15:01,992 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000129 2017-08-22 05:15:01,992 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000129 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:15:01,992 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000129 from application application_1501810184023_55949 2017-08-22 05:15:01,992 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000129 2017-08-22 05:15:01,992 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:15:01,992 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000129 2017-08-22 05:15:01,993 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_e24_1501810184023_55949_01_000129] 2017-08-22 05:19:59,546 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000044 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,546 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000093 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,546 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000127 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,546 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Application application_1501810184023_55949 transitioned from RUNNING to FINISHING_CONTAINERS_WAIT 2017-08-22 05:19:59,546 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000044 2017-08-22 05:19:59,560 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000093 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000093/container_e24_1501810184023_55949_01_000093.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000093, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000093, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000093/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000093/container_e24_1501810184023_55949_01_000093.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000093/container_e24_1501810184023_55949_01_000093.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000093/tasks] 2017-08-22 05:19:59,572 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000093 is : 143 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000044/container_e24_1501810184023_55949_01_000044.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000044, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000044, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000044/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000044/container_e24_1501810184023_55949_01_000044.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000044/container_e24_1501810184023_55949_01_000044.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000044/tasks] 2017-08-22 05:19:59,576 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000044 is : 143 2017-08-22 05:19:59,595 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000127 2017-08-22 05:19:59,608 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000120 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,608 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000112 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,608 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000079 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,608 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000054 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,608 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000149 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,608 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000040 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,608 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000137 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000046 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000065 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000133 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000024 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000090 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000028 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000123 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000080 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000049 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000084 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000148 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000051 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000072 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000041 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000140 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000078 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000045 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000095 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000035 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000037 transitioned from RUNNING to KILLING 2017-08-22 05:19:59,609 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000120 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000127/container_e24_1501810184023_55949_01_000127.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000127, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000127, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000127/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000127/container_e24_1501810184023_55949_01_000127.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000127/container_e24_1501810184023_55949_01_000127.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000127/tasks] 2017-08-22 05:19:59,622 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000127 is : 143 2017-08-22 05:19:59,624 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000112 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000120/container_e24_1501810184023_55949_01_000120.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000120, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000120, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000120/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000120/container_e24_1501810184023_55949_01_000120.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000120/container_e24_1501810184023_55949_01_000120.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000120/tasks] 2017-08-22 05:19:59,635 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000120 is : 143 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000112/container_e24_1501810184023_55949_01_000112.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000112, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000112, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000112/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000112/container_e24_1501810184023_55949_01_000112.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000112/container_e24_1501810184023_55949_01_000112.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000112/tasks] 2017-08-22 05:19:59,636 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000112 is : 143 2017-08-22 05:19:59,641 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000079 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000079/container_e24_1501810184023_55949_01_000079.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000079, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000079, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000079/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000079/container_e24_1501810184023_55949_01_000079.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000079/container_e24_1501810184023_55949_01_000079.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000079/tasks] 2017-08-22 05:19:59,647 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000079 is : 143 2017-08-22 05:19:59,748 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000054 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000054/container_e24_1501810184023_55949_01_000054.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000054, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000054, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000054/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000054/container_e24_1501810184023_55949_01_000054.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000054/container_e24_1501810184023_55949_01_000054.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000054/tasks] 2017-08-22 05:19:59,764 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000054 is : 143 2017-08-22 05:19:59,764 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000149 2017-08-22 05:19:59,764 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_e24_1501810184023_55949_01_000045 succeeded 2017-08-22 05:19:59,764 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_e24_1501810184023_55949_01_000080 succeeded 2017-08-22 05:19:59,764 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_e24_1501810184023_55949_01_000090 succeeded Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000149/container_e24_1501810184023_55949_01_000149.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000149, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000149, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000149/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000149/container_e24_1501810184023_55949_01_000149.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000149/container_e24_1501810184023_55949_01_000149.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000149/tasks] 2017-08-22 05:19:59,770 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000149 is : 143 2017-08-22 05:19:59,785 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000040 2017-08-22 05:19:59,802 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000137 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000137/container_e24_1501810184023_55949_01_000137.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000137, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000137, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000137/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000137/container_e24_1501810184023_55949_01_000137.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000137/container_e24_1501810184023_55949_01_000137.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000137/tasks] 2017-08-22 05:19:59,810 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000137 is : 143 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000040/container_e24_1501810184023_55949_01_000040.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000040, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000040, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000040/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000040/container_e24_1501810184023_55949_01_000040.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000040/container_e24_1501810184023_55949_01_000040.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000040/tasks] 2017-08-22 05:19:59,813 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000040 is : 143 2017-08-22 05:19:59,820 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000046 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000046/container_e24_1501810184023_55949_01_000046.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000046, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000046, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000046/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000046/container_e24_1501810184023_55949_01_000046.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000046/container_e24_1501810184023_55949_01_000046.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000046/tasks] 2017-08-22 05:19:59,826 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000046 is : 143 2017-08-22 05:19:59,839 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000065 2017-08-22 05:19:59,841 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_e24_1501810184023_55949_01_000037 succeeded 2017-08-22 05:19:59,852 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000133 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000065/container_e24_1501810184023_55949_01_000065.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000065, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000065, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000065/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000065/container_e24_1501810184023_55949_01_000065.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000065/container_e24_1501810184023_55949_01_000065.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000065/tasks] 2017-08-22 05:19:59,858 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000065 is : 143 2017-08-22 05:19:59,872 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000024 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000133/container_e24_1501810184023_55949_01_000133.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000133, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000133, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000133/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000133/container_e24_1501810184023_55949_01_000133.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000133/container_e24_1501810184023_55949_01_000133.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000133/tasks] 2017-08-22 05:19:59,875 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000133 is : 143 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000024/container_e24_1501810184023_55949_01_000024.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000024, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000024, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000024/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000024/container_e24_1501810184023_55949_01_000024.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000024/container_e24_1501810184023_55949_01_000024.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000024/tasks] 2017-08-22 05:19:59,878 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000024 is : 143 2017-08-22 05:19:59,887 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000090 2017-08-22 05:19:59,899 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000028 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000028/container_e24_1501810184023_55949_01_000028.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000028, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000028, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000028/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000028/container_e24_1501810184023_55949_01_000028.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000028/container_e24_1501810184023_55949_01_000028.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000028/tasks] 2017-08-22 05:19:59,902 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000028 is : 143 2017-08-22 05:19:59,912 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000123 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000123/container_e24_1501810184023_55949_01_000123.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000123, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000123, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000123/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000123/container_e24_1501810184023_55949_01_000123.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000123/container_e24_1501810184023_55949_01_000123.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000123/tasks] 2017-08-22 05:19:59,919 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000123 is : 143 2017-08-22 05:19:59,925 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000080 2017-08-22 05:19:59,940 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000049 2017-08-22 05:19:59,953 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000084 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000049/container_e24_1501810184023_55949_01_000049.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000049, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000049, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000049/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000049/container_e24_1501810184023_55949_01_000049.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000049/container_e24_1501810184023_55949_01_000049.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000049/tasks] 2017-08-22 05:19:59,953 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000049 is : 143 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000084/container_e24_1501810184023_55949_01_000084.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000084, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000084, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000084/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000084/container_e24_1501810184023_55949_01_000084.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000084/container_e24_1501810184023_55949_01_000084.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000084/tasks] 2017-08-22 05:19:59,958 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000084 is : 143 2017-08-22 05:19:59,967 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000148 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000148/container_e24_1501810184023_55949_01_000148.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000148, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000148, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000148/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000148/container_e24_1501810184023_55949_01_000148.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000148/container_e24_1501810184023_55949_01_000148.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000148/tasks] 2017-08-22 05:19:59,973 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000148 is : 143 2017-08-22 05:19:59,981 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000051 2017-08-22 05:19:59,993 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000072 2017-08-22 05:19:59,993 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_e24_1501810184023_55949_01_000140 succeeded Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000072/container_e24_1501810184023_55949_01_000072.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000072, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000072, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000072/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000072/container_e24_1501810184023_55949_01_000072.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000072/container_e24_1501810184023_55949_01_000072.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000072/tasks] 2017-08-22 05:20:00,001 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000072 is : 143 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000051/container_e24_1501810184023_55949_01_000051.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000051, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000051, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000051/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000051/container_e24_1501810184023_55949_01_000051.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000051/container_e24_1501810184023_55949_01_000051.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000051/tasks] 2017-08-22 05:20:00,002 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000051 is : 143 2017-08-22 05:20:00,008 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000041 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000041/container_e24_1501810184023_55949_01_000041.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000041, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000041, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000041/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000041/container_e24_1501810184023_55949_01_000041.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000041/container_e24_1501810184023_55949_01_000041.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000041/tasks] 2017-08-22 05:20:00,015 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000041 is : 143 2017-08-22 05:20:00,023 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000140 2017-08-22 05:20:00,035 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000078 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000078/container_e24_1501810184023_55949_01_000078.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000078, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000078, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000078/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000078/container_e24_1501810184023_55949_01_000078.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000078/container_e24_1501810184023_55949_01_000078.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000078/tasks] 2017-08-22 05:20:00,047 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000045 2017-08-22 05:20:00,047 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000078 is : 143 2017-08-22 05:20:00,061 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000095 Writing to tmp file /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000095/container_e24_1501810184023_55949_01_000095.pid.tmp [nice, -n, 0, /usr/lib/hadoop-yarn/bin/container-executor, hdfs, hdfs, 1, application_1501810184023_55949, container_e24_1501810184023_55949_01_000095, /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000095, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000095/launch_container.sh, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000095/container_e24_1501810184023_55949_01_000095.tokens, /tmp/hadoop-yarn/nm-local-dir/nmPrivate/application_1501810184023_55949/container_e24_1501810184023_55949_01_000095/container_e24_1501810184023_55949_01_000095.pid, /tmp/hadoop-yarn/nm-local-dir, /var/log/hadoop-yarn/userlogs, cgroups=/cgroup/cpu/yarn/container_e24_1501810184023_55949_01_000095/tasks] 2017-08-22 05:20:00,067 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e24_1501810184023_55949_01_000095 is : 143 2017-08-22 05:20:00,069 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container container_e24_1501810184023_55949_01_000035 succeeded 2017-08-22 05:20:00,075 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000035 2017-08-22 05:20:00,089 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_e24_1501810184023_55949_01_000037 2017-08-22 05:20:00,108 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000045 transitioned from KILLING to EXITED_WITH_SUCCESS 2017-08-22 05:20:00,108 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000080 transitioned from KILLING to EXITED_WITH_SUCCESS 2017-08-22 05:20:00,108 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000090 transitioned from KILLING to EXITED_WITH_SUCCESS 2017-08-22 05:20:00,108 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000037 transitioned from KILLING to EXITED_WITH_SUCCESS 2017-08-22 05:20:00,108 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000149 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,108 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000140 transitioned from KILLING to EXITED_WITH_SUCCESS 2017-08-22 05:20:00,108 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000040 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,108 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000072 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,108 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000044 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,108 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000137 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,108 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000035 transitioned from KILLING to EXITED_WITH_SUCCESS 2017-08-22 05:20:00,108 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000049 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,108 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000084 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,108 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000024 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,108 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000045 2017-08-22 05:20:00,108 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000080 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000090 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000037 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000045 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000045 transitioned from EXITED_WITH_SUCCESS to DONE 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000080 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000080 transitioned from EXITED_WITH_SUCCESS to DONE 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000090 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000090 transitioned from EXITED_WITH_SUCCESS to DONE 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000037 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000037 transitioned from EXITED_WITH_SUCCESS to DONE 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000149 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000149 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000140 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000140 transitioned from EXITED_WITH_SUCCESS to DONE 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000040 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000040 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000072 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000072 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000044 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000044 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000137 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000137 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000035 2017-08-22 05:20:00,109 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000035 transitioned from EXITED_WITH_SUCCESS to DONE 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000049 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000049 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000084 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000084 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000024 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000024 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000045 from application application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000045 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000045 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000080 from application application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000080 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000080 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000090 from application application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000090 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000090 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000037 from application application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000037 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000037 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000149 from application application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000149 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000149 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000140 from application application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000140 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000140 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000040 from application application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000040 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000040 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000072 from application application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000072 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000072 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000044 from application application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000044 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000044 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000137 from application application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000137 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000137 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000035 from application application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000035 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000035 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000049 from application application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000049 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000049 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000084 from application application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000084 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000084 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000024 from application application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000024 2017-08-22 05:20:00,110 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,110 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000024 2017-08-22 05:20:00,111 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Event EventType: KILL_CONTAINER sent to absent container container_e24_1501810184023_55949_01_000037 2017-08-22 05:20:00,111 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Event EventType: KILL_CONTAINER sent to absent container container_e24_1501810184023_55949_01_000040 2017-08-22 05:20:00,111 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Event EventType: KILL_CONTAINER sent to absent container container_e24_1501810184023_55949_01_000045 2017-08-22 05:20:00,111 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Event EventType: KILL_CONTAINER sent to absent container container_e24_1501810184023_55949_01_000049 2017-08-22 05:20:00,111 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Event EventType: KILL_CONTAINER sent to absent container container_e24_1501810184023_55949_01_000072 2017-08-22 05:20:00,111 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Event EventType: KILL_CONTAINER sent to absent container container_e24_1501810184023_55949_01_000080 2017-08-22 05:20:00,111 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Event EventType: KILL_CONTAINER sent to absent container container_e24_1501810184023_55949_01_000084 2017-08-22 05:20:00,111 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Event EventType: KILL_CONTAINER sent to absent container container_e24_1501810184023_55949_01_000090 2017-08-22 05:20:00,111 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Event EventType: KILL_CONTAINER sent to absent container container_e24_1501810184023_55949_01_000137 2017-08-22 05:20:00,111 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Event EventType: KILL_CONTAINER sent to absent container container_e24_1501810184023_55949_01_000140 2017-08-22 05:20:00,111 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Event EventType: KILL_CONTAINER sent to absent container container_e24_1501810184023_55949_01_000149 2017-08-22 05:20:00,125 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000149 2017-08-22 05:20:00,129 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000140 2017-08-22 05:20:00,129 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000040 2017-08-22 05:20:00,130 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000072 2017-08-22 05:20:00,136 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000133 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,136 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000133 2017-08-22 05:20:00,136 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000133 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,136 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000133 from application application_1501810184023_55949 2017-08-22 05:20:00,136 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000133 2017-08-22 05:20:00,136 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,136 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000133 2017-08-22 05:20:00,138 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000044 2017-08-22 05:20:00,140 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000137 2017-08-22 05:20:00,140 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000035 2017-08-22 05:20:00,140 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000049 2017-08-22 05:20:00,157 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000084 2017-08-22 05:20:00,157 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000024 2017-08-22 05:20:00,158 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000133 2017-08-22 05:20:00,168 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000078 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,168 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000078 2017-08-22 05:20:00,168 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000078 2017-08-22 05:20:00,168 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000078 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,168 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000078 from application application_1501810184023_55949 2017-08-22 05:20:00,168 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000078 2017-08-22 05:20:00,168 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,168 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000078 2017-08-22 05:20:00,286 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000054 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,286 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000054 2017-08-22 05:20:00,287 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000054 2017-08-22 05:20:00,287 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000054 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,287 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000054 from application application_1501810184023_55949 2017-08-22 05:20:00,287 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000054 2017-08-22 05:20:00,287 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,287 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000054 2017-08-22 05:20:00,369 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000095 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,369 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000095 2017-08-22 05:20:00,369 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000095 2017-08-22 05:20:00,369 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000095 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,369 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000095 from application application_1501810184023_55949 2017-08-22 05:20:00,369 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000095 2017-08-22 05:20:00,369 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,369 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000095 2017-08-22 05:20:00,586 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000028 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,586 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000028 2017-08-22 05:20:00,586 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000028 2017-08-22 05:20:00,586 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000028 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,586 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000028 from application application_1501810184023_55949 2017-08-22 05:20:00,586 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000028 2017-08-22 05:20:00,586 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,586 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000028 2017-08-22 05:20:00,669 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000046 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,670 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000046 2017-08-22 05:20:00,670 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000046 2017-08-22 05:20:00,670 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000046 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,670 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000046 from application application_1501810184023_55949 2017-08-22 05:20:00,670 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000046 2017-08-22 05:20:00,670 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,670 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000046 2017-08-22 05:20:00,678 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000127 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,678 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000127 2017-08-22 05:20:00,678 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000127 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,678 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000127 from application application_1501810184023_55949 2017-08-22 05:20:00,678 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000127 2017-08-22 05:20:00,678 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,678 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000127 2017-08-22 05:20:00,678 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000127 2017-08-22 05:20:00,697 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000148 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,698 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000148 2017-08-22 05:20:00,698 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000148 2017-08-22 05:20:00,698 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000148 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,698 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000148 from application application_1501810184023_55949 2017-08-22 05:20:00,698 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000148 2017-08-22 05:20:00,698 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,698 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000148 2017-08-22 05:20:00,705 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000051 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,705 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000051 2017-08-22 05:20:00,705 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000051 2017-08-22 05:20:00,705 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000051 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,706 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000051 from application application_1501810184023_55949 2017-08-22 05:20:00,706 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000051 2017-08-22 05:20:00,706 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,706 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000051 2017-08-22 05:20:00,723 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000123 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,724 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000123 2017-08-22 05:20:00,724 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000123 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,724 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000123 from application application_1501810184023_55949 2017-08-22 05:20:00,724 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000123 2017-08-22 05:20:00,724 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,724 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000123 2017-08-22 05:20:00,724 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000123 2017-08-22 05:20:00,769 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000120 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,769 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000120 2017-08-22 05:20:00,769 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000120 2017-08-22 05:20:00,769 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000120 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,769 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000120 from application application_1501810184023_55949 2017-08-22 05:20:00,769 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000120 2017-08-22 05:20:00,769 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,769 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000120 2017-08-22 05:20:00,799 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000041 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,799 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000041 2017-08-22 05:20:00,799 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000041 2017-08-22 05:20:00,799 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000041 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,799 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000041 from application application_1501810184023_55949 2017-08-22 05:20:00,799 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000041 2017-08-22 05:20:00,799 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,799 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000041 2017-08-22 05:20:00,945 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000065 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:00,945 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000065 2017-08-22 05:20:00,945 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000065 2017-08-22 05:20:00,945 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000065 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:00,945 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000065 from application application_1501810184023_55949 2017-08-22 05:20:00,945 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000065 2017-08-22 05:20:00,945 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:00,945 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000065 2017-08-22 05:20:01,204 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000112 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:01,204 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000112 2017-08-22 05:20:01,204 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000112 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:01,204 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000112 from application application_1501810184023_55949 2017-08-22 05:20:01,204 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000112 2017-08-22 05:20:01,204 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:01,204 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000112 2017-08-22 05:20:01,205 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000112 2017-08-22 05:20:01,257 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000093 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:01,257 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000093 2017-08-22 05:20:01,257 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000093 2017-08-22 05:20:01,258 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000093 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:01,258 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000093 from application application_1501810184023_55949 2017-08-22 05:20:01,258 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000093 2017-08-22 05:20:01,258 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:01,258 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000093 2017-08-22 05:20:01,259 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000079 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-08-22 05:20:01,259 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hdfs OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1501810184023_55949 CONTAINERID=container_e24_1501810184023_55949_01_000079 2017-08-22 05:20:01,259 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_e24_1501810184023_55949_01_000079 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-08-22 05:20:01,259 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Removing container_e24_1501810184023_55949_01_000079 from application application_1501810184023_55949 2017-08-22 05:20:01,259 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Application application_1501810184023_55949 transitioned from FINISHING_CONTAINERS_WAIT to APPLICATION_RESOURCES_CLEANINGUP 2017-08-22 05:20:01,260 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Stopping resource-monitoring for container_e24_1501810184023_55949_01_000079 2017-08-22 05:20:01,260 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1501810184023_55949 2017-08-22 05:20:01,260 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping container container_e24_1501810184023_55949_01_000079 2017-08-22 05:20:01,260 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949/container_e24_1501810184023_55949_01_000079 2017-08-22 05:20:01,260 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_STOP for appId application_1501810184023_55949 2017-08-22 05:20:01,260 INFO org.apache.spark.network.yarn.YarnShuffleService: Stopping application application_1501810184023_55949 2017-08-22 05:20:01,260 INFO org.apache.spark.network.shuffle.ExternalShuffleBlockResolver: Application application_1501810184023_55949 removed, cleanupLocalDirs = false 2017-08-22 05:20:01,260 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting absolute path : /tmp/hadoop-yarn/nm-local-dir/usercache/hdfs/appcache/application_1501810184023_55949 2017-08-22 05:20:01,260 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl: Application application_1501810184023_55949 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED 2017-08-22 05:20:01,260 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler: Scheduling Log Deletion for application: application_1501810184023_55949, with delay of 1800 seconds 2017-08-22 05:50:01,261 INFO org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Deleting path : /var/log/hadoop-yarn/userlogs/application_1501810184023_55949