[SPARK-1107] Add shutdown hook on executor stop to stop running tasks

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 0.9.0
• Component/s: Spark Core
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Andrew Ash
• Created: 18/Feb/14 20:40
• Updated: 21/May/19 05:37
• Resolved: 21/May/19 05:37

Description

Originally reported by aash:

http://mail-archives.apache.org/mod_mbox/incubator-spark-dev/201402.mbox/%3CCA%2B-p3AHXYhpjXH9fr8jQ5%2B_gc%3DNHjLbOiJB9bHSahfEET5aHBQ%40mail.gmail.com%3E

Latest in thread:

http://mail-archives.apache.org/mod_mbox/incubator-spark-dev/201402.mbox/%3CCA+-p3AFi7vz=[e-mail]%3E

The most popular approach is to add a shutdown hook that stops running tasks in the executors.

Issue Links

• is related to: SPARK-650 Add a "setup hook" API for running initialization code on each executor