[SPARK-1089] ADD_JARS regression in Spark 0.9.0

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Fix Version/s: 0.9.1, 1.0.0
• Component/s: Spark Core
• Assignee: Nan Zhu
• Reporter: Andrew Ash
• Created: 13/Feb/14 14:25
• Updated: 09/Jul/14 18:12
• Resolved: 26/Feb/14 23:43

Description

Using the ADD_JARS environment variable with spark-shell used to add the jar to both the shell and the various workers. Now it only adds to the workers and importing a custom class in the shell is broken.

The workaround is to add custom jars to both ADD_JARS and SPARK_CLASSPATH.

We should fix ADD_JARS so it works properly again.

See various threads on the user list:
https://mail-archives.apache.org/mod_mbox/incubator-spark-user/201402.mbox/[e-mail]%3E
(another one that doesn't appear in the archives yet titled "ADD_JARS not working on 0.9")