[KYLIN-2371] Allow overwrite default spark conf in kylin.properties and project/cube level

• Type: Sub-task
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: v2.0.0
• Component/s: Spark Engine
• Assignee: Shao Feng Shi
• Reporter: Shao Feng Shi
• Created: 09/Jan/17 07:22
• Updated: 30/Apr/17 12:21
• Resolved: 19/Jan/17 03:23

Description

If user wants to customize some conf parameter for some cubes, he can define the conf with prefix "kylin.engine.spark-conf." in either "conf/kylin.properties" or at the project/cube level, e.g,

kylin.engine.spark-conf.spark.executor.instances=4

Then kylin will parse and apply the conf when submitting to spark, Kylin will run:

"spark/bin/spark-submit --conf spark.executor.instances=4 ..."