[SPARK-31900] Client memory passed unvalidated to the JVM Xmx

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 2.0.0, 3.0.0
• Component/s: Spark Submit
• Assignee: Unassigned
• Reporter: Gera Shegalov
• Created: 03/Jun/20 19:13
• Updated: 28/Sep/20 13:41
• Resolved: 28/Sep/20 13:41

Description

When launching in the client mode Spark launcher uses spark.driver.memory config (among other settings in the precedence order). Unlike the cluster mode, the client memory config is not trimmed and not validated to be a valid suffix for the Xmx option.

Issue Links

• links to: [Github] Pull Request #28720 (gerashegalov)