[SPARK-16414] Can not get user config when calling SparkHadoopUtil.get.conf in other places, such as DataSourceStrategy

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.6.2
• Fix Version/s: 2.0.0
• Component/s: Spark Core, YARN
• Labels: easyfix
• Target Version/s: 2.0.0
• Assignee: sharkd tu
• Reporter: sharkd tu
• Created: 07/Jul/16 11:27
• Updated: 17/May/20 18:13
• Resolved: 12/Jul/16 17:15

Description

Fix bugs for "Can not get user config when calling SparkHadoopUtil.get.conf in other places".

The `SparkHadoopUtil` singleton was instantiated before `ApplicationMaster`, So the `sparkConf` and `conf` in the `SparkHadoopUtil` singleton didn't include user's configuration.

see https://github.com/apache/spark/pull/14088

Issue Links

• links to: [Github] Pull Request #14088 (sharkdtu)