[SPARK-966] Sometimes DAGScheduler throws NullPointerException

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Fix Version/s: 0.9.0
• Assignee: liancheng
• Reporter: Qiuzhuang Lian
• Created: 27/Nov/13 01:30
• Updated: 07/Dec/13 14:46
• Resolved: 07/Dec/13 14:45

Description

When running some spark examples, I run into NullPointerException thrown by DAGScheduler. Log is as follows,

13/11/27 17:26:40 ERROR dispatch.TaskInvocation:
java.lang.NullPointerException
at org.apache.spark.scheduler.DAGScheduler$$anonfun$3$$anon$1$$anonfun$preStart$1.apply$mcV$sp(DAGScheduler.scala:116)
at akka.actor.DefaultScheduler$$anon$1.run(Scheduler.scala:142)
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:94)
at akka.jsr166y.ForkJoinTask$AdaptedRunnableAction.exec(ForkJoinTask.java:1381)
at akka.jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:259)
at akka.jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:975)
at akka.jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1479)
at akka.jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
13/11/27 17:26:42 WARN util.SizeEstimator: Failed to check whether UseCompressedOops is set; assuming yes