[SPARK-30256] Allow SparkLauncher to sudo before executing spark-submit

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: Spark Submit
• Assignee: Unassigned
• Reporter: Jeff Evans
• Created: 13/Dec/19 17:13
• Updated: 16/Mar/20 22:52

Description

It would be useful if org.apache.spark.launcher.SparkLauncher allowed for a "sudo as user X" option. This way, multi-tenant applications that run Spark jobs could give end users greater security, by ensuring that the files (including, importantly, keytabs) can remain readable only by the end users instead of the UID that runs this multi-tenant application itself. I believe that sudo -u <theUser> spark-submit <spark-submit-args> should work. The builder maintained by SparkLauncher could simply have a setSudoUser method.