[SPARK-41419] [K8S] Decrement PVC_COUNTER when the pod deletion happens

• Type: Task
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.4.0
• Component/s: Kubernetes
• Assignee: Unassigned
• Reporter: Ted Yu
• Created: 07/Dec/22 03:06
• Updated: 07/Dec/22 03:07

Description

commit cc55de3 introduced PVC_COUNTER to track outstanding number of PVCs.

PVC_COUNTER should only be decremented when the pod deletion happens (in response to error).

If the PVC isn't created successfully (where PVC_COUNTER isn't incremented) (possibly due to execution not reaching resource(pvc).create() call), we shouldn't decrement the counter.
variable `success` tracks the progress of PVC creation:

value 0 means PVC is not created.
value 1 means PVC has been created.
value 2 means PVC has been created but due to subsequent error, the pod is deleted.

Issue Links

• links to: [Github] Pull Request #38948 (tedyu)