[ZEPPELIN-4083] spark 2.4 uses a more recent commons-lang3

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Resolved
• Affects Version/s: 0.8.1
• Fix Version/s: 0.8.2
• Component/s: Interpreters, pySpark
• Assignee: Unassigned
• Reporter: chris
• Created: 21/Mar/19 15:31
• Updated: 20/May/21 07:12
• Resolved: 22/Mar/19 13:40

Description

It appears that there is a incompatibility between Spark 2.4 and Zeppelin 0.8.1 commons-lang3. Spark is using commons-lang3-3.5 while Zeppelin uses commons-lang3-3.4

This results in an error when trying to perform a spark.read.csv() error:

```java.io.InvalidClassException: org.apache.commons.lang3.time.FastDateParser; local class incompatible: stream classdesc serialVersionUID = 2, local class serialVersionUID = 3```

This issue only occurs when running in a standalone cluster mode, no probs working in local mode. Also this issue does not occur outside zeppelin using pyspark shell or spark-submit

I'm aware of related issues: 

ZEPPELIN-1977

ZEPPELIN-3939

However it's not clear there any solution except for waiting for subsequent versions of 0.8.x or 0.9.x 

 Your advice would be very much welcomed