Details
-
Bug
-
Status: Resolved
-
Minor
-
Resolution: Incomplete
-
None
-
None
Description
Mesos dispatcher handles DRIVER_ABORTED status for mesosDriver.run() during the successful registration but if the mesosDriver.run() returns DRIVER_ABORTED status after the successful register then there is no action for the status and the thread will be terminated.
I think we need to throw the exception and shutdown the dispatcher.
Attachments
Issue Links
- duplicates
-
SPARK-15142 Spark Mesos dispatcher becomes unusable when the Mesos master restarts
- Resolved
- is related to
-
SPARK-24641 Spark-Mesos integration doesn't respect request to abort itself
- Resolved
- relates to
-
SPARK-15288 Mesos dispatcher should handle gracefully when any thread gets UncaughtException
- Resolved
- links to