[SPARK-13602] o.a.s.deploy.worker.DriverRunner may leak the driver processes

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.1.0
• Component/s: Spark Core
• Assignee: Bryan Cutler
• Reporter: Shixiong Zhu
• Created: 01/Mar/16 23:22
• Updated: 26/May/17 20:46
• Resolved: 11/Aug/16 21:49

Description

If Worker calls "System.exit", DriverRunner will not kill the driver processes. We should add a shutdown hook in DriverRunner like o.a.s.deploy.worker.ExecutorRunner

Issue Links

• breaks: SPARK-20843 Cannot gracefully kill drivers which take longer than 10 seconds to die
• links to: [Github] Pull Request #11746 (BryanCutler)