[SPARK-31394] Support for Kubernetes NFS volume mounts

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.0
• Component/s: Kubernetes, Spark Core
• Assignee: Seongjin Cho Assign to me
• Reporter: Seongjin Cho
• Created: 09/Apr/20 08:11
• Updated: 26/Sep/20 23:29
• Resolved: 15/Apr/20 10:46

Description

Kubernetes supports various kinds of volumes, but Spark for Kubernetes supports only EmptyDir/HostDir/PVC. By adding support for NFS, we can use Spark for Kubernetes with NFS storage.

NFS could be used using PVC when we want to use some clean new empty disk space, but in order to use files in existing NFS shares, we need to use NFS volume mounts.

RP link: https://github.com/apache/spark/pull/27364

Issue Links

• is duplicated by: SPARK-26342 Support for NFS mount for Kubernetes
• links to: GitHub Pull Request #27364
• links to: GitHub Pull Request #28236