Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-1367

Spark 2 support broken

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Resolved
    • 0.7.0
    • None
    • Interpreters
    • None
    • Ubuntu 14.04, Spark-2.0.0 preview

    Description

      Current version of the zeppelin spark interpreter tries to call a method on the spark repl called "getAddedJars":

       jars = (String[]) Utils.invokeStaticMethod(
                    Utils.findClass("org.apache.spark.repl.Main"), "getAddedJars");
      

      calling code located here
      https://github.com/apache/zeppelin/blob/master/spark/src/main/java/org/apache/zeppelin/spark/SparkInterpreter.java

      But that causes an error on my installation of spark:

      ERROR [2016-08-25 01:22:05,043] ({pool-2-thread-2} Utils.java[invokeStaticMethod]:49) - org.apache.spark.repl.Main.getAddedJars()
      java.lang.NoSuchMethodException: org.apache.spark.repl.Main.getAddedJars()
      

      Looking Spark commit below (commited March 14), that method appears to be eliminated.
      https://github.com/apache/spark/blob/8301fadd8d269da11e72870b7a889596e3337839/repl/scala-2.11/src/main/scala/org/apache/spark/repl/Main.scala

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              ckchow Chris Chow
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: