[SPARK-2260] Spark submit standalone-cluster mode is broken

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.0.1
• Fix Version/s: 1.1.0
• Component/s: Spark Core
• Assignee: Andrew Or
• Reporter: Andrew Or
• Created: 24/Jun/14 18:12
• Updated: 27/Jun/16 22:08
• Resolved: 30/Jul/14 06:52

Description

Well, it is technically not officially supported... but we should still fix it.

In particular, important configs such as spark.master and the application jar are not propagated to the worker nodes properly, due to obvious missing pieces in the code.

Issue Links

• relates to: SPARK-3560 In yarn-cluster mode, the same jars are distributed through multiple mechanisms.
• links to: [Github] Pull Request #1538 (andrewor14)