[KYLIN-5058] Throws ConcurrentModificationException when building cube

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Implemented
• Affects Version/s: v4.0.0-beta
• Fix Version/s: v4.0.2
• Component/s: Spark Engine
• Assignee: Zhichao Zhang
• Reporter: Zhichao Zhang
• Created: 09/Aug/21 06:39
• Updated: 31/Aug/22 12:02
• Resolved: 31/Aug/22 12:02

Description

When building cubes, there is an error 'ConcurrentModificationException' thrown by Spark, but it does not impact the building job.

This is a known issue and was fixed on Spark 3.1.2.

https://issues.apache.org/jira/browse/SPARK-34731

Fixed PR: https://github.com/apache/spark/pull/31826 

So It needs to upgrade Spark 3.X version to 3.1.2