[SPARK-31486] spark.submit.waitForCompletion flag to control spark-submit exit in Standalone Cluster Mode

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.0
• Component/s: Spark Core
• Assignee: Akshat Bordia
• Reporter: Akshat Bordia
• Created: 19/Apr/20 15:19
• Updated: 10/Jun/20 04:01
• Resolved: 09/Jun/20 14:30

Description

Implementation of spark.submit.waitForCompletion flag which will control if the spark-submit process will wait to exit until the application finishes/fails/errors out. This flag is set to false by default where the application will exit after submission. 

Issue Links

• links to: [Github] Pull Request #28775 (Ngone51)
• links to: GitHub Pull Request #28258