[SPARK-27081] Support launching executors in existed Pods

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: Kubernetes, Spark Core
• Assignee: Unassigned
• Reporter: Klaus Ma
• Created: 07/Mar/19 06:01
• Updated: 17/May/20 18:24

Description

Currently, spark-submit (Kuberentes) creates Pods on-demand to launch executors. But in our case/enhancement, those Pods included Volumes are ready there. So we'd like to have an option for spark-submit (Kuberetens) to launch executors in existed Pods.

 

/cc @liyinan926