[SPARK-36462] Allow Spark on Kube to operate without polling or watchers

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: Kubernetes
• Assignee: Holden Karau
• Reporter: Holden Karau
• Created: 09/Aug/21 20:53
• Updated: 18/Aug/22 23:17
• Resolved: 18/Aug/22 23:16

Description

Add an option to Spark on Kube to not track the individual executor pods and just assume K8s is doing what it's asked. This would be a developer feature intended for minimizing load on etcd & driver.

Issue Links

• links to: [Github] Pull Request #34264 (holdenk)
• links to: [Github] Pull Request #34264 (holdenk)
• links to: [Github] Pull Request #36433 (holdenk)
• links to: [Github] Pull Request #36433 (holdenk)