[SPARK-40840] Support Keytab file passing as a k8s secret

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.3.0
• Component/s: Kubernetes, Spark Submit
• Assignee: Unassigned
• Reporter: Anirudh Vyas
• Created: 19/Oct/22 05:14
• Updated: 19/Oct/22 05:14

Description

Currently I can use 

--conf spark.kerberos.keytab=local://

It would be useful if I can make keytab file as a kubernetes secret and then reference the secret here instead of keytab file. Keytab file needs to be mounted using templates and it gets to be tedious needlessly when running driver on cluster mode.

 

I can help if directed on how to get this done.

Sub-Tasks

• Support k8s secret as keytab file when using kerberos on spark on kubernetes: Open
• Support s3 and hdfs paths for keytab file while being passed: Open