[SPARK-2423] Clean up SparkSubmit for readability

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.1
• Fix Version/s: 1.1.0
• Component/s: Spark Core
• Assignee: Andrew Or
• Reporter: Andrew Or
• Created: 09/Jul/14 20:54
• Updated: 05/Nov/14 10:45
• Resolved: 17/Jul/14 08:14

Description

It is currently not trivial to trace through how different combinations of cluster managers (e.g. yarn) and deploy modes (e.g. cluster) are processed in SparkSubmit. We should clean up the logic a little if we want to extend it.