[SPARK-40612] On Kubernetes for long running app Spark using an invalid principal to renew the delegation token

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0, 3.0.1, 3.0.2, 3.0.3, 3.1.0, 3.1.1, 3.1.2, 3.2.0, 3.1.3, 3.2.1, 3.3.0, 3.2.2
• Fix Version/s: 3.3.1, 3.2.3, 3.4.0
• Component/s: Security
• Assignee: Attila Zsolt Piros
• Reporter: Attila Zsolt Piros
• Created: 29/Sep/22 12:44
• Updated: 16/Oct/22 08:49
• Resolved: 30/Sep/22 21:53

Description

When the delegation token fetched at the first time the principal is the current user but the subsequent token renewals are using a MapReduce/Yarn specific principal even on Kubernetes.

Issue Links

• links to: [Github] Pull Request #38048 (attilapiros)