[SPARK-25128] multiple simultaneous job submissions against k8s backend cause driver pods to hang

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Incomplete
• Affects Version/s: 2.3.0
• Component/s: Kubernetes, Spark Core
• Labels: bulk-closed kubernetes
• Target Version/s: 3.0.0
• External issue URL: https://stackoverflow.com/questions/51843212/spark-driver-pod-stuck-in-waiting-podinitializing-state-in-kubernetes
• Assignee: Unassigned
• Reporter: Erik Erlandson
• Created: 15/Aug/18 19:49
• Updated: 25/May/21 01:50
• Resolved: 25/May/21 01:38

Description

User is reporting that multiple "simultaneous" (or rapidly in succession) job submissions against the k8s back-end are causing driver pods to hang in "Waiting: PodInitializing" state. They filed an associated question at [stackoverflow|https://stackoverflow.com/questions/51843212/spark-driver-pod-stuck-in-waiting-podinitializing-state-in-kubernetes].