[SPARK-37028] Add a 'kill' executor link in the Web UI.

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Do
• Affects Version/s: 3.3.0
• Component/s: Spark Core
• Assignee: Unassigned
• Reporter: weixiuli
• Created: 17/Oct/21 04:23
• Updated: 06/Jan/22 07:11
• Resolved: 06/Jan/22 07:11

Description

The executor which is running in a bad node(eg. The system is overloaded or disks are busy) or has big GC overheads may affect the efficiency of job execution, although there are speculative mechanisms to resolve this problem, but sometimes the speculated task may also run in a bad executor.
We should have a 'kill' link for each executor, similar to what we have for each stage, so it's easier for users to kill executors in the UI.

Issue Links

• is superceded by: SPARK-37810 Executor Rolling in Kubernetes environment
• links to: [Github] Pull Request #34302 (weixiuli)