Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-24232

Allow referring to kubernetes secrets as env variable

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 2.4.0
    • Kubernetes, Spark Core
    • None

    Description

      Allow referring to kubernetes secrets in the driver process via environment variables. This will allow developers to use secretes without leaking them in the code and at the same time secrets can be decoupled and managed separately. This can be used to refer to passwords, certificates etc while talking to other service (jdbc passwords, storage keys etc).

      So, at the deployment time, something like ``spark.kubernetes.driver.secretKeyRef.[EnvName]=<key>`` can be specified which will make [EnvName].[key] available as an environment variable and in the code its always referred as env variable [key].

      Attachments

        Activity

          People

            skonto Stavros Kontopoulos
            dharmesh.kakadia Dharmesh Kakadia
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: