[SPARK-1403] Spark on Mesos does not set Thread's context class loader

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.0.0, 1.3.0, 1.4.0
• Fix Version/s: 1.0.0
• Component/s: Spark Core

Environment

ubuntu 12.04 on vagrant

• Assignee: Unassigned
• Reporter: Bharath Bhushan
• Created: 03/Apr/14 02:54
• Updated: 14/Jul/15 02:59
• Resolved: 14/Jul/15 02:59

Description

I can run spark 0.9.0 on mesos but not spark 1.0.0. This is because the spark executor on mesos slave throws a java.lang.ClassNotFoundException for org.apache.spark.serializer.JavaSerializer.

The lengthy discussion is here: http://apache-spark-user-list.1001560.n3.nabble.com/java-lang-ClassNotFoundException-spark-on-mesos-td3510.html#a3513

Issue Links

• relates to: SPARK-1480 Choose classloader consistently inside of Spark codebase