Details
-
Sub-task
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
4.0.0
Description
Spark on K8S supports mounting volumes to driver and executor pods. It supports the subPath but not the subPathExpr K8S option, which allows using environment variables for the subPath. Further, hostPath volumes are always mounted as default type "". Providing a different hostPath volume type allows for more flexibility.
Add the following configuration options:
- spark.kubernetes.executor.volumes.[VolumeType].[VolumeName].mount.subPathExpr
- spark.kubernetes.executor.volumes.hostPath.[VolumeName].options.type
Attachments
Issue Links
- links to