[SPARK-36622] spark.history.kerberos.principal doesn't take value _HOST

• Type: Improvement
• Status: In Progress
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.0.1, 3.1.2, 3.2.0
• Component/s: Deploy, Security, Spark Core
• Assignee: Unassigned
• Reporter: Pralabh Kumar
• Created: 31/Aug/21 09:19
• Updated: 08/Sep/21 10:59

Description

spark.history.kerberos.principal doesn't understand value _HOST. 

It says failure to login for principal : spark/_HOST@realm . 

It will be helpful to take _HOST value via config file and change it with current hostname(similar to what Hive does) . This will also help to run SHS on multiple machines without hardcoding principal hostname.  .spark.history.kerberos.principal

 

It require minor change in HistoryServer.scala in initSecurity  method . 

 

Please let me know , if this request make sense , I'll create the PR . 

 

Issue Links

• links to: [Github] Pull Request #33917 (pralabhkumar)