[SPARK-1052] Spark on Mesos with CDH4.5.0 cannot start the Tasks properly

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Fix Version/s: 0.9.1, 1.0.0
• Assignee: Bijay Singh Bisht
• Reporter: Alberto Miorin
• Created: 04/Feb/14 13:48
• Updated: 16/Feb/14 16:55
• Resolved: 16/Feb/14 16:55

Description

Steps :
Start the mesos cluster with the deb 0.15 from mesosphere.
Install cdh 4.5.0.
Start the spark-shell with this code :

val data = 1 to 10000
val distData = sc.parallelize(data)
distData.filter(_< 10).collect()

The tasks die because of an exception.

It used to work with Spark 0.8.0