[ZEPPELIN-5312] Zeppelin 0.9.0 with spark 3.1.1 interpeter can't load delta io classes

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.9.0
• Fix Version/s: 0.9.1
• Component/s: Core, Interpreters, pySpark, spark, zeppelin-interpreter
• Labels: patch

Environment

• Zeppelin 0.9.0
• Spark 3.1.1
• Python 3.7.9
• Delta io 0.8.0

• Flags: Important
• Assignee: Unassigned
• Reporter: Dmitry Kravchuk
• Created: 06/Apr/21 20:13
• Updated: 07/Apr/21 11:13

Description

I'm using Hadoop on prem with environment described below and it works fine with parquet in zeppelin but it can't load any delta io class and fails with batch of errors but I have configured spark 3 interpreter with needed paths. It's working okay with delta io lib with spark-submit except delta table update operations. Which information do you need to be able to help me with this issue? Is zeppelin 0.9.0 possible to work with delta io 0.8.0 or not?

Thank you.