Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-30256

Allow SparkLauncher to sudo before executing spark-submit

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 3.1.0
    • Fix Version/s: None
    • Component/s: Spark Submit
    • Labels:
      None

      Description

      It would be useful if org.apache.spark.launcher.SparkLauncher allowed for a "sudo as user X" option. This way, multi-tenant applications that run Spark jobs could give end users greater security, by ensuring that the files (including, importantly, keytabs) can remain readable only by the end users instead of the UID that runs this multi-tenant application itself. I believe that sudo -u <theUser> spark-submit <spark-submit-args> should work. The builder maintained by SparkLauncher could simply have a setSudoUser method.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jeff.w.evans Jeff Evans
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: