[SPARK-3243] spark.driver.* system properties are outdated if --driver-* options exist

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.2
• Fix Version/s: 1.1.0
• Component/s: Spark Core
• Target Version/s: 1.1.0
• Assignee: Andrew Or
• Reporter: Andrew Or
• Created: 27/Aug/14 03:49
• Updated: 27/Aug/14 21:47
• Resolved: 27/Aug/14 21:47

Description

If we set "spark.driver.extraClassPath" AND "--driver-class-path", then the latter correctly overrides the former. However! The value of the system property "spark.driver.extraClassPath" remains the former, which is not actually used.

That is just an example. Of course this also affects java options, library path and memory etc.

Issue Links

• links to: [Github] Pull Request #2154 (andrewor14)