[SPARK-2996] Standalone and Yarn have different settings for adding the user classpath first

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.3.0
• Component/s: Spark Core, YARN
• Target Version/s: 1.3.0
• Assignee: Marcelo Masiero Vanzin
• Reporter: Marcelo Masiero Vanzin
• Created: 13/Aug/14 01:59
• Updated: 28/Feb/15 03:15
• Resolved: 10/Feb/15 05:19

Description

Standalone uses "spark.files.userClassPathFirst" while Yarn uses "spark.yarn.user.classpath.first". Adding support for the former in Yarn should be pretty trivial.

Don't know if Mesos has anything similar.

Issue Links

• is duplicated by: SPARK-4739 spark.files.userClassPathFirst does not work in local[*] mode
• is duplicated by: SPARK-5358 spark.files.userClassPathFirst doesn't work correctly
• is duplicated by: SPARK-3053 Reconcile spark.files.userClassPathFirst with spark.yarn.user.classpath.first
• relates to: SPARK-5358 spark.files.userClassPathFirst doesn't work correctly
• links to: [Github] Pull Request #3233 (vanzin)