[SPARK-2608] Mesos doesn't handle spark.executor.extraJavaOptions correctly (among other things)

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.1.0
• Component/s: Mesos
• Target Version/s: 1.1.0
• Assignee: Unassigned
• Reporter: Fei Wang
• Created: 21/Jul/14 16:11
• Updated: 28/Aug/14 18:08
• Resolved: 27/Aug/14 19:41

Description

mesos scheduler backend use spark-class/spark-executor to launch executor backend, this will lead to problems:
1 when set spark.executor.extraJavaOptions CoarseMesosSchedulerBackend will throw error
2 spark.executor.extraJavaOptions and spark.executor.extraLibraryPath set in sparkconf will not be valid

Issue Links

• is duplicated by: SPARK-2921 Mesos doesn't handle spark.executor.extraJavaOptions correctly (among other things)
• links to: [Github] Pull Request #2161 (liancheng)