[SPARK-21655] Kill CLI for Yarn mode

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 2.1.1
• Component/s: Spark Core, YARN
• Assignee: Unassigned
• Reporter: Jong Yoon Lee
• Shepherd: Thomas Graves
• Created: 07/Aug/17 13:46
• Updated: 17/May/20 18:13
• Resolved: 26/Sep/17 08:41

Description

Similar to how standalone and Mesos have the capability to safely shut down the spark application, there should be a way to safely shut down spark on Yarn mode. This will ensure a clean shutdown and unregistration from yarn.

This is the design doc:
https://docs.google.com/document/d/1QG8hITjLNi1D9dVR3b_hZkyrGm5FFm0u9M1KGM4y1Ak/edit?usp=sharing

and I will upload the patch soon

Issue Links

• incorporates: SPARK-21737 Create communication channel between arbitrary clients and the Spark AM in YARN mode
• links to: [Github] Pull Request #18897 (yoonlee95)