[SPARK-23257] Kerberos Support in Kubernetes resource manager (Cluster Mode)

• Type: Wish
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 3.0.0
• Component/s: Kubernetes, Spark Core
• Assignee: Ilan Filonenko
• Reporter: Rob Keevil
• Created: 29/Jan/18 12:42
• Updated: 17/May/20 18:25
• Resolved: 15/Oct/18 22:51

Description

On the forked k8s branch of Spark at https://github.com/apache-spark-on-k8s/spark/pull/540 , Kerberos support has been added to the Kubernetes resource manager.  The Kubernetes code between these two repositories appears to have diverged, so this commit cannot be merged in easily.  Are there any plans to re-implement this work on the main Spark repository?

 

ifilonenko liyinan926 I am happy to help with the development and testing of this, but i wanted to confirm that this isn't already in progress -  I could not find any discussion about this specific topic online.

Issue Links

• is a child of: SPARK-25826 Kerberos Support in Kubernetes resource manager
• is depended upon by: SPARK-25750 Integration Testing for Kerberos Support for Spark on Kubernetes
• is depended upon by: SPARK-25751 Unit Testing for Kerberos Support for Spark on Kubernetes
• links to: [Github] Pull Request #21669 (ifilonenko)
• links to: [Github] Pull Request #22608 (ifilonenko)
• links to: GitHub Pull Request #21669