[SPARK-36623] Improve spark exit logic

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.2.0
• Component/s: Spark Core, YARN
• Assignee: Unassigned
• Reporter: angerszhu
• Created: 31/Aug/21 09:34
• Updated: 31/Aug/21 09:34

Sub-Tasks

• PythonRunner failed should pass error message to ApplicationMaster too: In Progress
• yarn-cluster mode, unregister timeout cause spark retry but AM container exit with code 0: In Progress
• Client mode submit task client should keep same exitcode with AM: In Progress
• SparkConnectServer should make client and AM same exit code: In Progress