[ZEPPELIN-4115] Case classes do not work with Spark New Interpreter

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: 0.8.1
• Component/s: zeppelin-interpreter

Environment

Zeppelin 0.8.1.  Spark 2.2.2 . RHEL 7.

• Assignee: Unassigned
• Reporter: Mark Bidewell
• Created: 10/Apr/19 13:14
• Updated: 29/Apr/19 12:09
• Resolved: 26/Apr/19 14:41

Description

If I define a scala case class and attempt to use it in a notebook such as the following code snippet:

case class Test(id: String, role: String, resst: String)
val test = Test("1", "Hello", "World")
val rdd1 = sc.parallelize(List(test))

rdd1.first()

The run will fail with different exceptions - either MethodNotFound or ClassNotFound.  In contrast if zeppelin.spark.useNew is false the code works as expected.

Issue Links

• is cloned by: ZEPPELIN-4116 SQL UDF do not work with Spark New Interpreter