[SPARK-15288] Mesos dispatcher should handle gracefully when any thread gets UncaughtException

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.2.0
• Component/s: Deploy, Mesos
• Assignee: Devaraj Kavali
• Reporter: Devaraj Kavali
• Created: 12/May/16 06:22
• Updated: 25/Feb/17 21:49
• Resolved: 25/Feb/17 21:49

Description

Any one thread of the Mesos dispatcher gets any of the UncaughtException then the thread gets terminate and the dispatcher process keeps running without functioning properly.

I think we need to handle the UncaughtException and shutdown the Mesos dispatcher.

Issue Links

• is related to: SPARK-15359 Mesos dispatcher should handle DRIVER_ABORTED status from mesosDriver.run()
• links to: [Github] Pull Request #13072 (devaraj-kavali)
• links to: [Github] Pull Request #13073 (clockfly)