Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25500

Specify configmap and secrets in Spark driver and executor pods in Kubernetes

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Won't Fix
    • 2.3.1
    • None
    • Kubernetes, Spark Core
    • None

    Description

      This uses SPARK-23529. Support for specifying configmap and secrets as spark-configuration is requested.

      Using PR #22146, the above functionality can be achieved by passing template file. However, for spark properties (like log4j.properties, fairscheduler.xml and metrics.properties), we are proposing this approach as this is native to other configuration options specifications in spark.

      The configmaps and secrets have to be pre-created before using this as spark configuration.

      Attachments

        Activity

          People

            Unassigned Unassigned
            abhisrao Abhishek Rao
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: