[ZEPPELIN-1367] Spark 2 support broken

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Resolved
• Affects Version/s: 0.7.0
• Component/s: Interpreters

Environment

Ubuntu 14.04, Spark-2.0.0 preview

• Assignee: Unassigned Assign to me
• Reporter: Chris Chow
• Created: 24/Aug/16 21:40
• Updated: 29/Jun/17 09:13
• Resolved: 14/Nov/16 15:13

Description

Current version of the zeppelin spark interpreter tries to call a method on the spark repl called "getAddedJars":

 jars = (String[]) Utils.invokeStaticMethod(
              Utils.findClass("org.apache.spark.repl.Main"), "getAddedJars");

calling code located here
https://github.com/apache/zeppelin/blob/master/spark/src/main/java/org/apache/zeppelin/spark/SparkInterpreter.java

But that causes an error on my installation of spark:

ERROR [2016-08-25 01:22:05,043] ({pool-2-thread-2} Utils.java[invokeStaticMethod]:49) - org.apache.spark.repl.Main.getAddedJars()
java.lang.NoSuchMethodException: org.apache.spark.repl.Main.getAddedJars()

Looking Spark commit below (commited March 14), that method appears to be eliminated.
https://github.com/apache/spark/blob/8301fadd8d269da11e72870b7a889596e3337839/repl/scala-2.11/src/main/scala/org/apache/spark/repl/Main.scala

Issue Links

• is related to: ZEPPELIN-759 Support for Spark 2.0 (ideally with Scala 2.11)