[AMBARI-12284] Ambari omits the line to enable kerberos on the Spark History Service

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 2.3.0
• Assignee: Robert Levas
• Reporter: Steve Loughran
• Created: 06/Jul/15 03:41
• Updated: 06/Aug/15 23:21
• Resolved: 06/Aug/15 20:10

Description

Ambari omits the line to enable kerberos on the Spark History Service

When Ambari sets up a secure spark cluster, it doesn't set
This will still fail tests unless the line
spark.history.kerberos.enabled true
is added to spark-defaults.conf
without this the Spark History Service will not log in with the keytab, and so not set up a long-lived secure connection to a Yarn History Server with encryption on.
This isn't immediately visible (and hard to sport in the tests), because if the user spark has logged in with kinit, the TGT is picked up and used —which works until the ticket expires.