[SPARK-1906] spark-submit doesn't send master URL to Driver in standalone cluster mode

• Type: Sub-task
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.1.0
• Component/s: Deploy
• Assignee: Andrew Or
• Reporter: Xiangrui Meng
• Created: 22/May/14 22:09
• Updated: 12/Sep/14 21:48
• Resolved: 12/Sep/14 21:48

Description

`spark-submit` doesn't send `spark.master` to DriverWrapper. So the latter creates an empty SparkConf and throws an exception:

A master URL must be set in your configuration

The workaround is setting master explicitly in the user application.

Issue Links

• relates to: SPARK-2000 cannot connect to cluster in Standalone mode when run spark-shell in one of the cluster node without specify master