[SPARK-34478] Ignore or reject wrong config when start sparksession

• Type: Improvement
• Status: In Progress
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.2.0
• Component/s: Spark Core, SQL
• Assignee: Unassigned
• Reporter: angerszhu
• Created: 20/Feb/21 02:38
• Updated: 13/Sep/21 22:16

Description

When use 

SparkSession.builder().config()

In this method user may config `spark.driver.memory`. But when we run this code, jvm is started,  so this configuration won't work and in Spark UI, it will show as this configuration. 

So we should ignore such as wrong way.

Issue Links

• links to: [Github] Pull Request #31598 (AngersZhuuuu)
• links to: [Github] Pull Request #31598 (AngersZhuuuu)

Sub-Tasks

• Add scope tag in configuration: In Progress