[SPARK-30771] Failed mount warning from kubernetes and support the "optional" mount.

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Component/s: Kubernetes, Spark Core
• Assignee: Unassigned
• Reporter: Prashant Sharma
• Created: 10/Feb/20 09:52
• Updated: 17/May/20 18:26

Description

1)https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.17/#configmapvolumesource-v1-core

Kubernetes allows an optional field indicating, that if the mount for this config map fails, then it is not reattempted nor the pod is declared to be failed.

In our current code base, we try to mount the volumes and create them later, it works because, kubernetes reattempts failed mounting attempt, because the `optional` field is `false` by default.

But, if this optional field is set to true, then that mount will not take place at all. Because, when the mount is performed the volume is not created - so mount fails. And this time the mount is not reattempted because the optional field is set as true.

Issue Links

• links to: GitHub Pull Request #27520