[KYLIN-5462] KYLIN4 limit the initial size of the executor

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: v4.0.3
• Component/s: Job Engine
• Assignee: Unassigned
• Reporter: xjlem
• Created: 21/Feb/23 13:51
• Updated: 21/Feb/23 14:25

Description

Kylin will auto set "spark.executor.instances",but if we enable spark dynamic allocation,the "spark.executor.instances" can over "spark.dynamicAllocation.maxExecutors" and it will cause job execute fail