[SPARK-32913] Improve ExecutorDecommissionInfo and ExecutorDecommissionState for different use cases

• Type: Sub-task
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: Spark Core
• Assignee: Unassigned
• Reporter: wuyi
• Created: 17/Sep/20 14:22
• Updated: 17/Sep/20 15:04

Description

Basically, there are 3 decommission use cases: k8s, standalone, dynamic allocation. And they are all using the DecommissionInfo to represent their own case. But, DecommissionInfo now is not enough to tell whether the decommission is triggered at executor or not after SPARK-32850. So, it's the time to improve both DecommissionInfo and DecommissionState.

Issue Links

• links to: [Github] Pull Request #29788 (Ngone51)
• links to: [Github] Pull Request #29788 (Ngone51)