[SPARK-36614] Executor loss reason shows "worker lost" rather "Executor decommission"

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.2, 3.2.0, 3.3.0
• Fix Version/s: 3.2.0, 3.1.3
• Component/s: Spark Core
• Assignee: wuyi
• Reporter: wuyi
• Created: 30/Aug/21 12:47
• Updated: 25/Jan/22 12:50
• Resolved: 30/Aug/21 16:10

Description

For a lost executor caused by decommission, the loss reason shows "worker lost", while it is actually due to decommission.

Issue Links

• causes: SPARK-38023 ExecutorMonitor.onExecutorRemoved should handle ExecutorDecommission as finished
• links to: [Github] Pull Request #33868 (Ngone51)
• links to: [Github] Pull Request #33868 (Ngone51)