Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-31394

Support for Kubernetes NFS volume mounts

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.1.0
    • Fix Version/s: 3.1.0
    • Component/s: Kubernetes, Spark Core
    • Labels:
      None

      Description

      Kubernetes supports various kinds of volumes, but Spark for Kubernetes supports only EmptyDir/HostDir/PVC. By adding support for NFS, we can use Spark for Kubernetes with NFS storage.

      NFS could be used using PVC when we want to use some clean new empty disk space, but in order to use files in existing NFS shares, we need to use NFS volume mounts.

      RP link: https://github.com/apache/spark/pull/27364

        Attachments

          Activity

            People

            • Assignee:
              sjcho Seongjin Cho
              Reporter:
              sjcho Seongjin Cho
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: