[ZEPPELIN-3456] Livy Interpreter incompatible with Spark 2.2+

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.7.3
• Component/s: Interpreters, livy-interpreter
• Assignee: Unassigned
• Reporter: Mathew Wicks
• Created: 14/May/18 04:05
• Updated: 09/Jun/18 08:08

Description

Issue:

Zeppelin's Livy interpreter dose not support Spark 2.2+, as the job fails to initialize after we call a removed method (As of Spark 2.2)

This is very similar to ZEPPELIN-2150 for the main Spark interpreter. 

 

Environment:

• Livy 0.5
• Spark 2.2+

 

Specifics:

We still try to call (the now removed as of Spark 2.2) "appUIAddress":
https://github.com/apache/zeppelin/blob/master/livy/src/main/java/org/apache/zeppelin/livy/LivySparkInterpreter.java#L51