[SPARK-45183] ExecutorPodsLifecycleManager delete a pod multi times.

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.2.0
• Component/s: Kubernetes

Environment

Spark 3.2.0

• Assignee: Unassigned
• Reporter: hgs
• Created: 16/Sep/23 01:20
• Updated: 19/Sep/23 13:57

Description

 Because `ExecutorPodsLifecycleManager`.`removedExecutorsCache` is not thread safe, will cause a pod deleted many times when  `ExecutorPodsLifecycleManager`.`onNewSnapshots` called by multi threads.