2015-02-20 08:52:00,328 INFO [main] yarn.ApplicationMaster (SignalLogger.scala:register(47)) - Registered signal handlers for [TERM, HUP, INT] 2015-02-20 08:52:01,458 WARN [main] util.NativeCodeLoader (NativeCodeLoader.java:(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2015-02-20 08:52:01,752 INFO [main] yarn.ApplicationMaster (Logging.scala:logInfo(59)) - ApplicationAttemptId: appattempt_1424451097199_0001_000001 2015-02-20 08:52:01,966 INFO [main] spark.SecurityManager (Logging.scala:logInfo(59)) - Changing view acls to: noland 2015-02-20 08:52:01,967 INFO [main] spark.SecurityManager (Logging.scala:logInfo(59)) - Changing modify acls to: noland 2015-02-20 08:52:01,968 INFO [main] spark.SecurityManager (Logging.scala:logInfo(59)) - SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(noland); users with modify permissions: Set(noland) 2015-02-20 08:52:01,999 WARN [main] util.Utils (Logging.scala:logWarning(71)) - Your hostname, localhost.localdomain resolves to a loopback address: 127.0.0.1; using 172.17.171.124 instead (on interface en0) 2015-02-20 08:52:02,000 WARN [main] util.Utils (Logging.scala:logWarning(71)) - Set SPARK_LOCAL_IP if you need to bind to another address 2015-02-20 08:52:02,596 INFO [sparkYarnAM-akka.actor.default-dispatcher-4] slf4j.Slf4jLogger (Slf4jLogger.scala:applyOrElse(80)) - Slf4jLogger started 2015-02-20 08:52:02,656 INFO [sparkYarnAM-akka.actor.default-dispatcher-4] Remoting (Slf4jLogger.scala:apply$mcV$sp(74)) - Starting remoting 2015-02-20 08:52:02,945 INFO [sparkYarnAM-akka.actor.default-dispatcher-4] Remoting (Slf4jLogger.scala:apply$mcV$sp(74)) - Remoting started; listening on addresses :[akka.tcp://sparkYarnAM@172.17.171.124:57838] 2015-02-20 08:52:02,947 INFO [sparkYarnAM-akka.actor.default-dispatcher-4] Remoting (Slf4jLogger.scala:apply$mcV$sp(74)) - Remoting now listens on addresses: [akka.tcp://sparkYarnAM@172.17.171.124:57838] 2015-02-20 08:52:02,955 INFO [main] util.Utils (Logging.scala:logInfo(59)) - Successfully started service 'sparkYarnAM' on port 57838. 2015-02-20 08:52:02,956 INFO [main] yarn.ApplicationMaster (Logging.scala:logInfo(59)) - Waiting for Spark driver to be reachable. 2015-02-20 08:52:02,962 INFO [main] yarn.ApplicationMaster (Logging.scala:logInfo(59)) - Driver now available: 172.17.171.124:57834 2015-02-20 08:52:02,975 INFO [sparkYarnAM-akka.actor.default-dispatcher-4] yarn.ApplicationMaster (Logging.scala:logInfo(59)) - Listen to driver: akka.tcp://sparkDriver@172.17.171.124:57834/user/YarnScheduler 2015-02-20 08:52:02,996 INFO [sparkYarnAM-akka.actor.default-dispatcher-4] yarn.ApplicationMaster (Logging.scala:logInfo(59)) - Add WebUI Filter. AddWebUIFilter(org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter,Map(PROXY_HOSTS -> localhost, PROXY_URI_BASES -> http://localhost:57822/proxy/application_1424451097199_0001),/proxy/application_1424451097199_0001) 2015-02-20 08:52:03,032 INFO [main] client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at localhost/127.0.0.1:57814 2015-02-20 08:52:03,131 INFO [main] yarn.YarnRMClient (Logging.scala:logInfo(59)) - Registering the ApplicationMaster 2015-02-20 08:52:03,481 INFO [main] yarn.YarnAllocator (Logging.scala:logInfo(59)) - Will request 2 executor containers, each with 2 cores and 896 MB memory including 384 MB overhead 2015-02-20 08:52:03,490 INFO [main] yarn.YarnAllocator (Logging.scala:logInfo(59)) - Container request (host: Any, capability: ) 2015-02-20 08:52:03,491 INFO [main] yarn.YarnAllocator (Logging.scala:logInfo(59)) - Container request (host: Any, capability: ) 2015-02-20 08:52:03,559 INFO [main] yarn.ApplicationMaster (Logging.scala:logInfo(59)) - Started progress reporter thread - sleep time : 5000 2015-02-20 08:52:08,587 INFO [Reporter] impl.AMRMClientImpl (AMRMClientImpl.java:populateNMTokens(361)) - Received new token for : localhost:57824 2015-02-20 08:52:08,597 INFO [Reporter] yarn.YarnAllocator (Logging.scala:logInfo(59)) - Received 2 containers from YARN, launching executors on 0 of them. 2015-02-20 09:01:48 Full thread dump Java HotSpot(TM) 64-Bit Server VM (24.51-b03 mixed mode): "Reporter" daemon prio=5 tid=0x00007fa1ead1e800 nid=0x7503 waiting on condition [0x00000001159c4000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$1.run(ApplicationMaster.scala:335) "IPC Parameter Sending Thread #0" daemon prio=5 tid=0x00007fa1eba91800 nid=0x7303 waiting on condition [0x00000001158c1000] java.lang.Thread.State: TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00000007fe3bfda8> (a java.util.concurrent.SynchronousQueue$TransferStack) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) "IPC Client (617948508) connection to localhost/127.0.0.1:57814 from noland" daemon prio=5 tid=0x00007fa1eba6f000 nid=0x7103 in Object.wait() [0x00000001157be000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00000007fe3bea98> (a org.apache.hadoop.ipc.Client$Connection) at org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:920) - locked <0x00000007fe3bea98> (a org.apache.hadoop.ipc.Client$Connection) at org.apache.hadoop.ipc.Client$Connection.run(Client.java:965) "Hashed wheel timer #1" daemon prio=5 tid=0x00007fa1eba42000 nid=0x6f03 waiting on condition [0x00000001156bb000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at org.jboss.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:467) at org.jboss.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:376) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at java.lang.Thread.run(Thread.java:744) "New I/O server boss #6" daemon prio=5 tid=0x00007fa1e9b6c000 nid=0x6d03 runnable [0x00000001155b8000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:200) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x00000007fe24d678> (a sun.nio.ch.Util$2) - locked <0x00000007fe24d688> (a java.util.Collections$UnmodifiableSet) - locked <0x00000007fe24d628> (a sun.nio.ch.KQueueSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) at org.jboss.netty.channel.socket.nio.NioServerBoss.select(NioServerBoss.java:163) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:206) at org.jboss.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) "New I/O worker #5" daemon prio=5 tid=0x00007fa1eb9fc800 nid=0x6b03 runnable [0x00000001154b5000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:200) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x00000007fe220888> (a sun.nio.ch.Util$2) - locked <0x00000007fe220898> (a java.util.Collections$UnmodifiableSet) - locked <0x00000007fe220838> (a sun.nio.ch.KQueueSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.jboss.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:64) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:409) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:206) at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) "New I/O worker #4" daemon prio=5 tid=0x00007fa1e9e31800 nid=0x6903 runnable [0x00000001153b2000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:200) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x00000007fe2236f0> (a sun.nio.ch.Util$2) - locked <0x00000007fe2236e0> (a java.util.Collections$UnmodifiableSet) - locked <0x00000007fe2235b0> (a sun.nio.ch.KQueueSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.jboss.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:64) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:409) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:206) at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) "New I/O boss #3" daemon prio=5 tid=0x00007fa1eaa75800 nid=0x6703 runnable [0x00000001152af000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:200) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x00000007fe223ce0> (a sun.nio.ch.Util$2) - locked <0x00000007fe223cf0> (a java.util.Collections$UnmodifiableSet) - locked <0x00000007fe223c90> (a sun.nio.ch.KQueueSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.jboss.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:64) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:409) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:206) at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:41) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) "New I/O worker #2" daemon prio=5 tid=0x00007fa1eaa74800 nid=0x6503 runnable [0x00000001151ac000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:200) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x00000007fe3457e8> (a sun.nio.ch.Util$2) - locked <0x00000007fe3457f8> (a java.util.Collections$UnmodifiableSet) - locked <0x00000007fe345798> (a sun.nio.ch.KQueueSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.jboss.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:64) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:409) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:206) at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) "New I/O worker #1" daemon prio=5 tid=0x00007fa1ea766800 nid=0x6303 runnable [0x00000001150a9000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:200) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x00000007fe4a9f80> (a sun.nio.ch.Util$2) - locked <0x00000007fe4a9f90> (a java.util.Collections$UnmodifiableSet) - locked <0x00000007fe345d18> (a sun.nio.ch.KQueueSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.jboss.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:64) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:409) at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:206) at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:88) at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) "sparkYarnAM-akka.remote.default-remote-dispatcher-6" daemon prio=5 tid=0x00007fa1eb9d3000 nid=0x6103 waiting on condition [0x0000000114fa6000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00000007fe462f10> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool) at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) "sparkYarnAM-akka.remote.default-remote-dispatcher-5" daemon prio=5 tid=0x00007fa1eae6e800 nid=0x5f03 waiting on condition [0x0000000114ea3000] java.lang.Thread.State: TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00000007fe462f10> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool) at scala.concurrent.forkjoin.ForkJoinPool.idleAwaitWork(ForkJoinPool.java:2135) at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2067) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) "sparkYarnAM-akka.actor.default-dispatcher-3" daemon prio=5 tid=0x00007fa1eaac2000 nid=0x5b03 waiting on condition [0x0000000114a97000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00000007fe435fa0> (a akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinPool) at scala.concurrent.forkjoin.ForkJoinPool.scan(ForkJoinPool.java:2075) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) "sparkYarnAM-scheduler-1" daemon prio=5 tid=0x00007fa1eb99a800 nid=0x5707 waiting on condition [0x0000000112fdf000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at akka.actor.LightArrayRevolverScheduler.waitNanos(Scheduler.scala:226) at akka.actor.LightArrayRevolverScheduler$$anon$8.nextTick(Scheduler.scala:405) at akka.actor.LightArrayRevolverScheduler$$anon$8.run(Scheduler.scala:375) at java.lang.Thread.run(Thread.java:744) "Service Thread" daemon prio=5 tid=0x00007fa1e904b800 nid=0x4c03 runnable [0x0000000000000000] java.lang.Thread.State: RUNNABLE "C2 CompilerThread1" daemon prio=5 tid=0x00007fa1e904b000 nid=0x4a03 waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE "C2 CompilerThread0" daemon prio=5 tid=0x00007fa1e9049800 nid=0x4803 waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE "Signal Dispatcher" daemon prio=5 tid=0x00007fa1e9045800 nid=0x4603 waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE "Finalizer" daemon prio=5 tid=0x00007fa1e903a000 nid=0x3103 in Object.wait() [0x0000000110de7000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00000007fe2dfd00> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135) - locked <0x00000007fe2dfd00> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151) at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:189) "Reference Handler" daemon prio=5 tid=0x00007fa1e9037000 nid=0x2f03 in Object.wait() [0x0000000110ce4000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00000007fe2df838> (a java.lang.ref.Reference$Lock) at java.lang.Object.wait(Object.java:503) at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133) - locked <0x00000007fe2df838> (a java.lang.ref.Reference$Lock) "main" prio=5 tid=0x00007fa1e980f000 nid=0x1903 in Object.wait() [0x000000010ad52000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00000007f6b1c3f8> (a org.apache.spark.deploy.yarn.ApplicationMaster$$anon$1) at java.lang.Thread.join(Thread.java:1280) - locked <0x00000007f6b1c3f8> (a org.apache.spark.deploy.yarn.ApplicationMaster$$anon$1) at java.lang.Thread.join(Thread.java:1354) at org.apache.spark.deploy.yarn.ApplicationMaster.runExecutorLauncher(ApplicationMaster.scala:289) at org.apache.spark.deploy.yarn.ApplicationMaster.run(ApplicationMaster.scala:146) at org.apache.spark.deploy.yarn.ApplicationMaster$$anonfun$main$1.apply$mcV$sp(ApplicationMaster.scala:577) at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:60) at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:59) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:59) at org.apache.spark.deploy.yarn.ApplicationMaster$.main(ApplicationMaster.scala:575) at org.apache.spark.deploy.yarn.ExecutorLauncher$.main(ApplicationMaster.scala:598) at org.apache.spark.deploy.yarn.ExecutorLauncher.main(ApplicationMaster.scala) "VM Thread" prio=5 tid=0x00007fa1e9036800 nid=0x2d03 runnable "GC task thread#0 (ParallelGC)" prio=5 tid=0x00007fa1e9822000 nid=0x2503 runnable "GC task thread#1 (ParallelGC)" prio=5 tid=0x00007fa1ea003000 nid=0x2703 runnable "GC task thread#2 (ParallelGC)" prio=5 tid=0x00007fa1ea004000 nid=0x2903 runnable "GC task thread#3 (ParallelGC)" prio=5 tid=0x00007fa1ea800000 nid=0x2b03 runnable "VM Periodic Task Thread" prio=5 tid=0x00007fa1ea072000 nid=0x4e03 waiting on condition JNI global references: 259 Heap PSYoungGen total 142848K, used 43836K [0x00000007f5500000, 0x00000007fee00000, 0x0000000800000000) eden space 133632K, 25% used [0x00000007f5500000,0x00000007f76d0a00,0x00000007fd780000) from space 9216K, 99% used [0x00000007fe200000,0x00000007feafe810,0x00000007feb00000) to space 10752K, 0% used [0x00000007fd780000,0x00000007fd780000,0x00000007fe200000) ParOldGen total 87040K, used 5704K [0x00000007e0000000, 0x00000007e5500000, 0x00000007f5500000) object space 87040K, 6% used [0x00000007e0000000,0x00000007e0592348,0x00000007e5500000) PSPermGen total 29696K, used 29545K [0x00000007dae00000, 0x00000007dcb00000, 0x00000007e0000000) object space 29696K, 99% used [0x00000007dae00000,0x00000007dcada5b0,0x00000007dcb00000)