Details
-
Improvement
-
Status: Resolved
-
Minor
-
Resolution: Won't Fix
-
2.3.1
-
None
-
None
Description
This uses SPARK-23529. Support for specifying configmap and secrets as spark-configuration is requested.
Using PR #22146, the above functionality can be achieved by passing template file. However, for spark properties (like log4j.properties, fairscheduler.xml and metrics.properties), we are proposing this approach as this is native to other configuration options specifications in spark.
The configmaps and secrets have to be pre-created before using this as spark configuration.