[KYLIN-5201] build and merge job use different spark config

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: v4.0.1
• Component/s: Job Engine
• Assignee: Unassigned
• Reporter: PENGHUAJIE
• Created: 23/Jun/22 07:39
• Updated: 24/Jun/22 02:30

Description

The build job and the merge job have different requirements for spark resources, I hope to distinguish the spark configuration，including

kylin.engine.spark-conf.spark.executor.instances

kylin.engine.spark-conf.spark.executor.memory

kylin.engine.spark-conf.spark.executor.cores

kylin.engine.spark-conf.spark.executor.memoryOverhead