[SPARK-4739] spark.files.userClassPathFirst does not work in local[*] mode

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.1.0
• Component/s: Deploy
• Assignee: Unassigned
• Reporter: Tobias Pfeiffer
• Created: 04/Dec/14 07:08
• Updated: 28/Feb/15 03:15
• Resolved: 28/Feb/15 03:15

Description

The parameter "spark.files.userClassPathFirst=true" does not work when using spark-submit with "--master local[3]". In particular, even though my application jar file contains netty-3.9.4.Final, the older version from the spark-assembly jar file is loaded (cf. SPARK-4738). When using the same jars with "--master yarn-cluster" and "spark.yarn.user.classpath.first=true" (cf. SPARK-2996), it works correctly and my bundled classes are used.

Issue Links

• duplicates: SPARK-2996 Standalone and Yarn have different settings for adding the user classpath first
• is related to: SPARK-5358 spark.files.userClassPathFirst doesn't work correctly