[ZEPPELIN-3881] Adding BigDL as a dependency to Spark interpreter causes indefinite pending cells, UI instability.

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Resolved
• Affects Version/s: 0.7.3, 0.8.0
• Fix Version/s: 0.9.0
• Component/s: GUI, Interpreters, zeppelin-server
• Labels: performance

Environment

Environment 1: Zeppelin 0.7.3 via HDP 2.6.5 on Centos 7

Environment 2: Zeppelin 0.8.0 on Ubuntu 14.04 via Docker

• Assignee: Unassigned
• Reporter: Derek Tapley
• Created: 26/Nov/18 20:33
• Updated: 24/Dec/20 03:16
• Resolved: 04/Dec/18 18:03

Description

Adding BigDL version 0.7.0 via Maven Central to the default Spark interpreter seems to cause behind-the-scenes stability issues.  Although no errors are given on the Interpreters page after adding the dependency, attempting to run a %spark paragraph with even trivial expressions (val x = 1) results in an indefinitely pending cell.  Attempting to restart the interpreter results in nothing, and (usually) loading other notebooks no longer becomes possible.  After checking both the interpreter and zeppelin server log files, I couldn't find any lines pertaining to why those paragraphs are pending indefinitely.

Issue Links

• is related to: ZEPPELIN-3856 Zeppelin add Hadoop Submarine (machine learning) interpreter
• is related to: ZEPPELIN-3689 Shade all dependencies of zeppelin-interpreter