[OOZIE-3071] Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 4.3.0
• Component/s: core
• Labels: patch
• Assignee: Artem Ervits
• Reporter: Ran Gu
• Created: 28/Sep/17 20:24
• Updated: 06/Feb/20 11:46

Description

Currently Oozie 4.3.0 uses commons-lang3 version 3.3.2 in Spark sharelib.
Spark 2.2.0 uses commons-lang3 version 3.5.
This causes Oozie(/Spark) job failures on EMR-5.8.0 clusters.

Error message:
17/08/22 00:22:43 ERROR ApplicationMaster: User class threw exception: java.lang.IllegalArgumentException: Illegal pattern component: XXX
java.lang.IllegalArgumentException: Illegal pattern component: XXX
at org.apache.commons.lang3.time.FastDatePrinter.parsePattern(FastDatePrinter.java:282)
at org.apache.commons.lang3.time.FastDatePrinter.init(FastDatePrinter.java:149)
at org.apache.commons.lang3.time.FastDatePrinter.<init>(FastDatePrinter.java:142)
at org.apache.commons.lang3.time.FastDateFormat.<init>(FastDateFormat.java:384)
at org.apache.commons.lang3.time.FastDateFormat.<init>(FastDateFormat.java:369)
at org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:91)
at org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:88)
at org.apache.commons.lang3.time.FormatCache.getInstance(FormatCache.java:82)

Issue Links

• links to: ReviewBoard