[SPARK-19179] spark.yarn.access.namenodes description is wrong

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.0.2
• Fix Version/s: 2.2.0
• Component/s: Spark Core, YARN
• Assignee: Saisai Shao
• Reporter: Thomas Graves
• Created: 11/Jan/17 15:37
• Updated: 17/May/20 18:13
• Resolved: 17/Jan/17 15:32

Description

The description and name of spark.yarn.access.namenodes is off. It says this is for HDFS namenodes when really this is to specify any hadoop filesystems. It gets the credentials for those filesystems.

We should at least update the description on it to be more generic. We could change the name on it but we would have to deprecated it and keep around current name as many people use it.

Issue Links

• links to: [Github] Pull Request #16560 (jerryshao)