[SPARK-19688] Spark on Yarn Credentials File set to different application directory

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.6.3
• Fix Version/s: 1.6.4, 2.0.3, 2.1.2, 2.2.0, 2.3.0
• Component/s: DStreams, Spark Core, YARN
• Assignee: Xing Shi
• Reporter: Devaraj Jonnadula
• Created: 21/Feb/17 23:09
• Updated: 17/May/20 18:15
• Resolved: 19/Jun/17 17:27

Description

spark.yarn.credentials.file property is set to different application Id instead of actual Application Id

Issue Links

• is duplicated by: SPARK-21008 Streaming applications read stale credentials file when recovering from checkpoint.
• links to: [Github] Pull Request #18230 (saturday-shi)