[SPARK-6301] Unable to load external jars while submitting Spark Job

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.2.0
• Component/s: PySpark, Spark Submit
• Assignee: Unassigned
• Reporter: raju patel
• Created: 12/Mar/15 08:44
• Updated: 16/Mar/15 11:18
• Resolved: 16/Mar/15 11:18

Description

We are using Jnius to call Java functions from Python. But when we are trying to submit the job using Spark,it is not able to load the java classes that are provided in the --jars option, although it is successfully able to load python class.
The Error is like this :
c = find_javaclass(clsname)
File "jnius_export_func.pxi", line 23, in jnius.find_javaclass (jnius/jnius.c:12815)
JavaException: Class not found

Issue Links

• duplicates: SPARK-5185 pyspark --jars does not add classes to driver class path