[SPARK-1863] Allowing user jars to take precedence over Spark jars does not work as expected

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Incomplete
• Affects Version/s: 1.0.0
• Component/s: Spark Core
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: koert kuipers
• Created: 16/May/14 23:36
• Updated: 21/May/19 05:36
• Resolved: 21/May/19 05:36

Description

See here:
http://apache-spark-user-list.1001560.n3.nabble.com/java-serialization-errors-with-spark-files-userClassPathFirst-true-td5832.html

The issue seems to be that within ChildExecutorURLClassLoader userClassLoader has no visibility on classes managed by parentClassLoader because their is no parent/child relationship. What this means that if a class is loaded by userClassLoader and it refers to a class loaded by parentClassLoader you get a NoClassDefFoundError.

Issue Links

• is duplicated by: SPARK-5358 spark.files.userClassPathFirst doesn't work correctly
• is related to: SPARK-5358 spark.files.userClassPathFirst doesn't work correctly