[ZEPPELIN-759] Support for Spark 2.0 (ideally with Scala 2.11)

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.6.1
• Component/s: Interpreters
• Assignee: Lee Moon Soo
• Reporter: Deenar Toraskar
• Created: 23/Mar/16 10:30
• Updated: 14/Nov/16 20:13
• Resolved: 24/Jul/16 01:15

Description

Add support for Spark 2.0. Zeppelin does not work with both scala-2.10 and scala-2.11 for spark-2.0.0, for now.

There will be "java.lang.ClassNotFoundException: org.apache.spark.repl.SparkCommandLine" when trying spark-2.0.0 with scala-2.11,

"java.lang.NoSuchMethodException: org.apache.spark.repl.SparkILoop$SparkILoopInterpreter.classServerUri" when trying spark-2.0.0 with scala-2.10.

Issue Links

• blocks: ZEPPELIN-1177 Release 0.6.1
• duplicates: ZEPPELIN-871 add spark 2.0 interpreter with scala 2.11
• duplicates: ZEPPELIN-450 Scala-2.11 support for Spark Interpreter
• is related to: ZEPPELIN-605 Support Scala 2.11
• relates to: ZEPPELIN-1227 Update spark-2.0.0-preview to spark-2.0.0 after Spark 2.0.0 release artifact available in maven
• relates to: ZEPPELIN-1228 z.show() does not work in spark 2.0
• relates to: ZEPPELIN-1367 Spark 2 support broken
• links to: GitHub Pull Request #1169
• links to: GitHub Pull Request #1195