[SPARK-8063] Spark master URL conflict between MASTER env variable and --master command line option

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 1.4.1, 1.5.0
• Component/s: SparkR
• Assignee: Sun Rui
• Reporter: Sun Rui
• Created: 03/Jun/15 04:31
• Updated: 03/Jun/15 18:58
• Resolved: 03/Jun/15 18:57

Description

Currently, Spark supports several ways to specify the Spark master URL, like --master option for spark-submit, spark.master configuration option, MASTER env variable. They have different precedences, for example, --master overrides MASTER if both are specified.

However, for SparkR shell, it always use the master URL specified by MASTER, not honoring --master.

Issue Links

• links to: [Github] Pull Request #6605 (sun-rui)