[SPARK-3599] Avoid loading and printing properties file content frequently

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Component/s: Deploy
• Assignee: Tao Wang (Inactive)
• Reporter: Tao Wang (Inactive)
• Created: 19/Sep/14 02:54
• Updated: 21/Sep/14 02:08
• Resolved: 21/Sep/14 02:08

Description

When I use -v | -verbos in spark-submit, there prints lots of message about contents in properties file.
After checking code in SparkSubmit.scala and SparkSubmitArguments.scala, I found the "getDefaultSparkProperties" method is invoked in three places, and every time we invoke it, we load properties from properties file, and print again if option -v used.

We might should use a value instead of method when we use default properties.

Issue Links

• relates to: SPARK-3620 Refactor config option handling code for spark-submit
• links to: [Github] Pull Request #2454 (WangTaoTheTonic)