[SPARK-10616] GradientBoostedTrees stuck with 2958359 features train data - ASF JIRA

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Duplicate
Affects Version/s: 1.4.1
Fix Version/s: None
Component/s: MLlib
Labels:
None

Description

I run a job to train a Gradient Boosting Decision Tree. The code works well on a small part where the features is about 20 thousands. But, when I run it on one data data where there are 2958359 features in total. The job get stuck after finished "collect at DecisionTree.scala:977".
Here is the statistics of my enviorment and logs, from the logs you can see it stop working at 15/09/15 18:50:57, 2 hours has passed no process at all, and I'm sure the memory is enough for this job. I hope someone can help me with this problem, thanks!
Storage
RDD Name Storage Level Cached Partitions Fraction Cached Size in Memory Size in ExternalBlockStore Size on Disk
MapPartitionsRDD Memory Deserialized 1x Replicated 200 100% 771.7 MB 0.0 B 0.0 B
MapPartitionsRDD Memory Deserialized 1x Replicated 200 100% 771.7 MB 0.0 B 0.0 B

Environment
Runtime Information
Name Value
Java Home /opt/jdk1.8.0_60/jre
Java Version 1.8.0_60 (Oracle Corporation)
Scala Version version 2.10.4
Spark Properties
Name Value
spark.akka.frameSize 100
spark.akka.threads 4
spark.app.id application_1442215126745_0068
spark.app.name GBDT_MODEL
spark.broadcast.compress true
spark.broadcast.factory org.apache.spark.broadcast.TorrentBroadcastFactory
spark.closure.serializer org.apache.spark.serializer.JavaSerializer
spark.driver.extraJavaOptions -Xmn2G -Xms4G -XX:MaxPermSize=200m -XX:+UseConcMarkSweepGC -XX:+PrintGC -XX:+PrintGCDetails -Xloggc:/tmp/spark.driver.gc.log -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp
spark.driver.extraLibraryPath /usr/lib/hadoop/lib/native
spark.driver.host 10.47.1.38
spark.driver.memory 32g
spark.driver.port 29651
spark.dynamicAllocation.enabled false
spark.dynamicAllocation.executorIdleTimeout 120
spark.dynamicAllocation.initialExecutors 10
spark.dynamicAllocation.maxExecutors 500
spark.dynamicAllocation.minExecutors 10
spark.dynamicAllocation.schedulerBacklogTimeout 5
spark.dynamicAllocation.sustainedSchedulerBacklogTimeout 5
spark.eventLog.compress true
spark.eventLog.dir hdfs:///data/spark/logs/1.4
spark.eventLog.enabled true
spark.executor.extraJavaOptions -Xmn1G -XX:+UseG1GC
spark.executor.extraLibraryPath /usr/lib/hadoop/lib/native
spark.executor.heartbeatInterval 10000
spark.executor.id driver
spark.executor.instances 300
spark.executor.memory 16g
spark.externalBlockStore.folderName spark-ff489341-5ce7-47bc-b0d3-a3011300f3fc
spark.file.transferTo false
spark.fileserver.uri http://10.47.1.38:42401
spark.io.compression.codec org.apache.spark.io.LZFCompressionCodec
spark.master yarn-cluster
spark.org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter.param.PROXY_HOST jt4dg.prod.mediav.com
spark.org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter.param.PROXY_URI_BASE http://jt4dg.prod.mediav.com:9099/proxy/application_1442215126745_0068
spark.rdd.compress true
spark.rpc.askTimeout 60
spark.rpc.retry.wait 3000
spark.rpc.timeout 300
spark.scheduler.maxRegisteredResourcesWaitingTime 3s
spark.scheduler.mode FAIR
spark.serializer org.apache.spark.serializer.KryoSerializer
spark.shuffle.service.enabled true
spark.speculation false
spark.sql.autoBroadcastJoinThreshold 104857600
spark.sql.codegen false
spark.sql.hive.convertMetastoreParquet true
spark.sql.inMemoryColumnarStorage.batchSize 1000
spark.sql.inMemoryColumnarStorage.compressed true
spark.sql.parquet.binaryAsString true
spark.sql.parquet.cacheMetadata true
spark.sql.parquet.compression.codec lzo
spark.sql.parquet.filterPushdown false
spark.sql.parquet.useDataSourceApi true
spark.sql.shuffle.partitions 200
spark.storage.blockManagerHeartBeatMs 120
spark.storage.memoryFraction 0.6
spark.storage.unrollFraction 0.2
spark.task.cpus 1
spark.task.maxFailures 8
spark.ui.filters org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter
spark.ui.killEnabled true
spark.ui.port 0
spark.ui.retainedStages 1000
spark.yarn.am.extraJavaOptions -Xmn1G -XX:+UseG1GC
spark.yarn.am.extraLibraryPath /usr/lib/hadoop/lib/native
spark.yarn.am.memory 3G
spark.yarn.am.memoryOverhead 1024
spark.yarn.am.waitTime 300000
spark.yarn.app.attemptId 1
spark.yarn.app.container.log.dir /hadoopdir13/yarn/logs/application_1442215126745_0068/container_1442215126745_0068_01_000001
spark.yarn.app.id application_1442215126745_0068
spark.yarn.executor.memoryOverhead 1024
spark.yarn.historyServer.address jt1dg.prod.mediav.com:18080
spark.yarn.report.interval 1000

Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=200m; support was removed in 8.0
15/09/15 18:50:12 INFO yarn.ApplicationMaster: Registered signal handlers for [TERM, HUP, INT]
15/09/15 18:50:13 INFO yarn.ApplicationMaster: ApplicationAttemptId: appattempt_1442215126745_0068_000001
15/09/15 18:50:13 INFO spark.SecurityManager: Changing view acls to: yarn,wuwm
15/09/15 18:50:13 INFO spark.SecurityManager: Changing modify acls to: yarn,wuwm
15/09/15 18:50:13 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(yarn, wuwm); users with modify permissions: Set(yarn, wuwm)
15/09/15 18:50:14 INFO yarn.ApplicationMaster: Starting the user application in a separate Thread
15/09/15 18:50:14 INFO yarn.ApplicationMaster: Waiting for spark context initialization
15/09/15 18:50:14 INFO yarn.ApplicationMaster: Waiting for spark context initialization ...
15/09/15 18:50:14 INFO spark.SparkContext: Running Spark version 1.4.1
15/09/15 18:50:14 INFO spark.SecurityManager: Changing view acls to: yarn,wuwm
15/09/15 18:50:14 INFO spark.SecurityManager: Changing modify acls to: yarn,wuwm
15/09/15 18:50:14 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(yarn, wuwm); users with modify permissions: Set(yarn, wuwm)
15/09/15 18:50:14 INFO slf4j.Slf4jLogger: Slf4jLogger started
15/09/15 18:50:14 INFO Remoting: Starting remoting
15/09/15 18:50:15 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkDriver@10.47.1.38:29651]
15/09/15 18:50:15 INFO util.Utils: Successfully started service 'sparkDriver' on port 29651.
15/09/15 18:50:15 INFO spark.SparkEnv: Registering MapOutputTracker
15/09/15 18:50:15 INFO spark.SparkEnv: Registering BlockManagerMaster
15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir1/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-355c7a06-a8a1-406e-a2c1-fd0b48763e75
15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir2/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-7c209d1d-f00f-4bd5-85b2-c636bdb631af
15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir3/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-d81047b7-c58f-40df-9bfc-b6a5b024c4c5
15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir4/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-4a71d2e3-72a3-4622-9d40-69943cc1cc80
15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir5/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-1a94d11f-b6df-4c69-a971-08702bb97808
15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir6/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-2c944d2c-24f4-49f5-90bf-56121419a059
15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir7/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-b3a82a9b-5703-49b3-976e-70ccb5d43b0d
15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir8/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-96e20bee-4ed0-4907-be62-1dc511484797
15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir9/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-6129c0b6-c05d-417a-95c0-148e708686ee
15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir10/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-d625fd54-3982-4b08-baf2-a2b5946f5954
15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir11/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-504bb240-017e-4caa-89d0-81d60c38af4e
15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir12/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-c17183b4-9ee6-4e1b-877e-cd78d96fefb8
15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir13/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-75c6de8a-d443-47ae-9a7b-ad0a91a6ff2d
15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir14/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-2b9ea7fb-7a24-4229-af58-43c5a511e2f0
15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir15/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-17a6904a-7637-44ad-ad6c-c042d96617c3
15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir16/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-fc2372bb-f6d2-4bf6-987c-84c3271024d8
15/09/15 18:50:15 INFO storage.MemoryStore: MemoryStore started with capacity 17.2 GB
15/09/15 18:50:15 INFO spark.HttpFileServer: HTTP File server directory is /hadoopdir1/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/httpd-812c9f01-8931-4fbc-a93a-685ed2619fe9
15/09/15 18:50:15 INFO spark.HttpServer: Starting HTTP Server
15/09/15 18:50:15 INFO server.Server: jetty-8.y.z-SNAPSHOT
15/09/15 18:50:15 INFO server.AbstractConnector: Started SocketConnector@0.0.0.0:42401
15/09/15 18:50:15 INFO util.Utils: Successfully started service 'HTTP file server' on port 42401.
15/09/15 18:50:15 INFO spark.SparkEnv: Registering OutputCommitCoordinator
15/09/15 18:50:15 INFO ui.JettyUtils: Adding filter: org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter
15/09/15 18:50:15 INFO server.Server: jetty-8.y.z-SNAPSHOT
15/09/15 18:50:15 INFO server.AbstractConnector: Started SelectChannelConnector@0.0.0.0:8925
15/09/15 18:50:15 INFO util.Utils: Successfully started service 'SparkUI' on port 8925.
15/09/15 18:50:15 INFO ui.SparkUI: Started SparkUI at http://10.47.1.38:8925
15/09/15 18:50:15 INFO cluster.YarnClusterScheduler: Created YarnClusterScheduler
15/09/15 18:50:15 INFO scheduler.FairSchedulableBuilder: Created default pool default, schedulingMode: FIFO, minShare: 0, weight: 1
15/09/15 18:50:16 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 18554.
15/09/15 18:50:16 INFO netty.NettyBlockTransferService: Server created on 18554
15/09/15 18:50:16 INFO storage.BlockManagerMaster: Trying to register BlockManager
15/09/15 18:50:16 INFO storage.BlockManagerMasterEndpoint: Registering block manager 10.47.1.38:18554 with 17.2 GB RAM, BlockManagerId(driver, 10.47.1.38, 18554)
15/09/15 18:50:16 INFO storage.BlockManagerMaster: Registered BlockManager
15/09/15 18:50:16 INFO scheduler.EventLoggingListener: Logging events to hdfs:///data/spark/logs/1.4/application_1442215126745_0068_1.lzf
15/09/15 18:50:17 INFO cluster.YarnSchedulerBackend$YarnSchedulerEndpoint: ApplicationMaster registered as AkkaRpcEndpointRef(Actorakka://sparkDriver/user/YarnAM#308423925)
15/09/15 18:50:17 INFO yarn.YarnRMClient: Registering the ApplicationMaster
15/09/15 18:50:17 INFO yarn.YarnRMClient: Connecting to ResourceManager at jt5dg.prod.mediav.com/10.47.1.103:8030
15/09/15 18:50:17 INFO yarn.YarnAllocator: Will allocate 300 executor containers, each with 17408 MB memory including 1024 MB overhead
15/09/15 18:50:17 INFO yarn.YarnAllocator: Allocating 300 executor containers with 17408 of memory each.
15/09/15 18:50:17 INFO yarn.YarnAllocator: ResourceRequest (host : *, num containers: 300, priority = 1 , capability : <memory:17408, vCores:1>)
15/09/15 18:50:17 INFO yarn.ApplicationMaster: Started progress reporter thread - sleep time : 5000
15/09/15 18:50:18 INFO cluster.YarnClusterSchedulerBackend: SchedulerBackend is ready for scheduling beginning after waiting maxRegisteredResourcesWaitingTime: 3000(ms)
15/09/15 18:50:18 INFO cluster.YarnClusterScheduler: YarnClusterScheduler.postStartHook done
15/09/15 18:50:19 INFO storage.MemoryStore: ensureFreeSpace(179816) called with curMem=0, maxMem=18438322913
15/09/15 18:50:19 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 175.6 KB, free 17.2 GB)
15/09/15 18:50:19 INFO storage.MemoryStore: ensureFreeSpace(16266) called with curMem=179816, maxMem=18438322913
15/09/15 18:50:19 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 15.9 KB, free 17.2 GB)
15/09/15 18:50:19 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on 10.47.1.38:18554 (size: 15.9 KB, free: 17.2 GB)
15/09/15 18:50:19 INFO spark.SparkContext: Created broadcast 0 from textFile at MLUtils.scala:73
15/09/15 18:50:19 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library
15/09/15 18:50:19 INFO lzo.LzoCodec: Successfully loaded & initialized native-lzo library [hadoop-lzo rev 49753b4b5a029410c3bd91278c360c2241328387]
15/09/15 18:50:19 INFO mapred.FileInputFormat: Total input paths to process : 200
15/09/15 18:50:20 INFO spark.SparkContext: Starting job: reduce at MLUtils.scala:95
15/09/15 18:50:20 INFO scheduler.DAGScheduler: Got job 0 (reduce at MLUtils.scala:95) with 200 output partitions (allowLocal=false)
15/09/15 18:50:20 INFO scheduler.DAGScheduler: Final stage: ResultStage 0(reduce at MLUtils.scala:95)
15/09/15 18:50:20 INFO scheduler.DAGScheduler: Parents of final stage: List()
15/09/15 18:50:20 INFO scheduler.DAGScheduler: Missing parents: List()
15/09/15 18:50:20 INFO scheduler.DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[5] at map at MLUtils.scala:93), which has no missing parents
15/09/15 18:50:20 INFO storage.MemoryStore: ensureFreeSpace(3872) called with curMem=196082, maxMem=18438322913
15/09/15 18:50:20 INFO storage.MemoryStore: Block broadcast_1 stored as values in memory (estimated size 3.8 KB, free 17.2 GB)
15/09/15 18:50:20 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=199954, maxMem=18438322913
15/09/15 18:50:20 INFO storage.MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.0 KB, free 17.2 GB)
15/09/15 18:50:20 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on 10.47.1.38:18554 (size: 2.0 KB, free: 17.2 GB)
15/09/15 18:50:20 INFO spark.SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:874
15/09/15 18:50:20 INFO scheduler.DAGScheduler: Submitting 200 missing tasks from ResultStage 0 (MapPartitionsRDD[5] at map at MLUtils.scala:93)
15/09/15 18:50:20 INFO cluster.YarnClusterScheduler: Adding task set 0.0 with 200 tasks
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000032 for on host hd274dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd274dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000014 for on host hd261dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd261dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000078 for on host hd277dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd277dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000162 for on host hd282dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd261dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd274dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd282dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd277dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000198 for on host hd255dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd282dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd255dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000020 for on host hd286dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd286dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd255dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000044 for on host hd260dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd286dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd260dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000204 for on host hd273dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd273dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd260dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000008 for on host hd291dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd291dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd273dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000062 for on host hd264dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd264dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd291dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000180 for on host hd272dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd264dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd272dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000174 for on host hd285dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd272dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd285dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000132 for on host hd258dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd258dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd285dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000186 for on host hd290dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd290dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd258dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000156 for on host hd263dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd263dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd290dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000084 for on host hd289dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd289dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd263dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000102 for on host hd276dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd276dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd289dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000068 for on host hd281dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd281dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd276dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000108 for on host hd254dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd281dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd254dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000114 for on host hd257dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd254dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd257dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000038 for on host hd288dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd257dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd288dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000002 for on host hd275dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd288dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd275dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000096 for on host hd280dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd275dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd280dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000210 for on host hd279dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd280dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd279dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000168 for on host hd293dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd279dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd293dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000050 for on host hd266dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd293dg.prod.mediav.com:8041
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd266dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000144 for on host hd271dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd271dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000192 for on host hd284dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd284dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000090 for on host hd262dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd262dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000138 for on host hd278dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd278dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000056 for on host hd292dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd292dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000150 for on host hd265dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd265dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000120 for on host hd270dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd270dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000126 for on host hd283dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd283dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000026 for on host hd256dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd256dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000074 for on host hd287dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd287dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000033 for on host hd274dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd274dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000015 for on host hd261dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd261dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000079 for on host hd277dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd277dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000163 for on host hd282dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd282dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000199 for on host hd255dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd255dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000021 for on host hd286dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd286dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000045 for on host hd260dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd260dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000205 for on host hd273dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd273dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000009 for on host hd291dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd291dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000063 for on host hd264dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd264dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000181 for on host hd272dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd272dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000175 for on host hd285dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd285dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000133 for on host hd258dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd258dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000187 for on host hd290dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd290dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000157 for on host hd263dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd263dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000085 for on host hd289dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd289dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000103 for on host hd276dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd276dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000069 for on host hd281dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd281dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000109 for on host hd254dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd254dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000115 for on host hd257dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd257dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000039 for on host hd288dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd288dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000003 for on host hd275dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd275dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000097 for on host hd280dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd280dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000211 for on host hd279dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd279dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000169 for on host hd293dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd293dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000051 for on host hd266dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd266dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000145 for on host hd271dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd271dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000193 for on host hd284dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd284dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000091 for on host hd262dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd262dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000139 for on host hd278dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd278dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000057 for on host hd292dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd292dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000151 for on host hd265dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd265dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000121 for on host hd270dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd270dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000127 for on host hd283dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd283dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000027 for on host hd256dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd256dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000075 for on host hd287dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd287dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000034 for on host hd274dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd274dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000016 for on host hd261dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd261dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000080 for on host hd277dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd277dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000164 for on host hd282dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd282dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000200 for on host hd255dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd255dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000022 for on host hd286dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd286dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000046 for on host hd260dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd260dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000206 for on host hd273dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd273dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000010 for on host hd291dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd291dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000064 for on host hd264dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd264dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000182 for on host hd272dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd272dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000176 for on host hd285dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd285dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000134 for on host hd258dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd258dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000188 for on host hd290dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd290dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000158 for on host hd263dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd263dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000086 for on host hd289dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd289dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000104 for on host hd276dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd276dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000070 for on host hd281dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd281dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000110 for on host hd254dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd254dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000116 for on host hd257dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd257dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000040 for on host hd288dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd288dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000004 for on host hd275dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd275dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000098 for on host hd280dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd280dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000212 for on host hd279dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd279dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000170 for on host hd293dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd293dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000052 for on host hd266dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd266dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000146 for on host hd271dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd271dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000194 for on host hd284dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd284dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000092 for on host hd262dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd262dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000140 for on host hd278dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd278dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000058 for on host hd292dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd292dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000152 for on host hd265dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd265dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000122 for on host hd270dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd270dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000128 for on host hd283dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd283dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000028 for on host hd256dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd256dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000076 for on host hd287dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd287dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000035 for on host hd274dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd274dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000017 for on host hd261dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd261dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000081 for on host hd277dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd277dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000165 for on host hd282dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd282dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000201 for on host hd255dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd255dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000023 for on host hd286dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd286dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000047 for on host hd260dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd260dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000207 for on host hd273dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd273dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000011 for on host hd291dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd291dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000065 for on host hd264dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd264dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000183 for on host hd272dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd272dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000177 for on host hd285dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd285dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000135 for on host hd258dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd258dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000189 for on host hd290dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd290dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000159 for on host hd263dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd263dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000087 for on host hd289dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd289dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000105 for on host hd276dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd276dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000071 for on host hd281dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd281dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000111 for on host hd254dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd254dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000117 for on host hd257dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd257dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000041 for on host hd288dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd288dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000005 for on host hd275dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd275dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000099 for on host hd280dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd280dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000213 for on host hd279dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd279dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000171 for on host hd293dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd293dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000053 for on host hd266dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd266dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000147 for on host hd271dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd271dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000195 for on host hd284dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd284dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000093 for on host hd262dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd262dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000141 for on host hd278dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd278dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000059 for on host hd292dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd292dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000153 for on host hd265dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd265dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000123 for on host hd270dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd270dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000129 for on host hd283dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd283dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000029 for on host hd256dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd256dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000036 for on host hd274dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd274dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000018 for on host hd261dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd261dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000082 for on host hd277dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd277dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000166 for on host hd282dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd282dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000202 for on host hd255dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd255dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000024 for on host hd286dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd286dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000048 for on host hd260dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd260dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000208 for on host hd273dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd273dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000012 for on host hd291dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd291dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000066 for on host hd264dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd264dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000184 for on host hd272dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd272dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000178 for on host hd285dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd285dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000136 for on host hd258dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd258dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000190 for on host hd290dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd290dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000160 for on host hd263dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd263dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000088 for on host hd289dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd289dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000106 for on host hd276dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd276dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000072 for on host hd281dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd281dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000112 for on host hd254dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd254dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000118 for on host hd257dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd257dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000042 for on host hd288dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd288dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000006 for on host hd275dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd275dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000100 for on host hd280dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd280dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000214 for on host hd279dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd279dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000172 for on host hd293dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd293dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000054 for on host hd266dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd266dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000148 for on host hd271dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd271dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000196 for on host hd284dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd284dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000094 for on host hd262dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd262dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000142 for on host hd278dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd278dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000060 for on host hd292dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd292dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000154 for on host hd265dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd265dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000124 for on host hd270dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd270dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000130 for on host hd283dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd283dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000030 for on host hd256dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd256dg.prod.mediav.com
15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(_app_.jar -> resource

{, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }