Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26194

Support automatic spark.authenticate secret in Kubernetes backend

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.0.0
    • Component/s: Kubernetes, Spark Core
    • Labels:
      None

      Description

      Currently k8s inherits the default behavior for spark.authenticate, which is that the user must provide an auth secret.

      k8s doesn't have that requirement and could instead generate its own unique per-app secret, and propagate it to executors.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                vanzin Marcelo Masiero Vanzin
                Reporter:
                vanzin Marcelo Masiero Vanzin
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: