[SPARK-39657] YARN AM client should call the non-static setTokensConf method

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.1, 3.4.0
• Component/s: YARN
• Assignee: Chao Sun
• Reporter: Chao Sun
• Created: 01/Jul/22 16:53
• Updated: 01/Jul/22 20:47
• Resolved: 01/Jul/22 20:47

Description

As part of SPARK-37205, Spark uses reflection to call setTokensConf method from YARN AM. However, it should invoke it as a non-static method instead of a static one.

Issue Links

• is caused by: SPARK-37205 Support mapreduce.job.send-token-conf when starting containers in YARN
• links to: [Github] Pull Request #37050 (sunchao)