[SPARK-5388] Provide a stable application submission gateway in standalone cluster mode

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.2.0
• Fix Version/s: 1.3.0
• Component/s: Spark Core
• Target Version/s: 1.3.0
• Assignee: Andrew Or
• Reporter: Andrew Or
• Created: 23/Jan/15 19:16
• Updated: 14/Jul/16 08:18
• Resolved: 06/Feb/15 23:57

Description

The existing submission gateway in standalone mode is not compatible across Spark versions. If you have a newer version of Spark submitting to an older version of the standalone Master, it is currently not guaranteed to work. The goal is to provide a stable REST interface to replace this channel.

For more detail, please see the most recent design doc attached.

Issue Links

• is related to: SPARK-16532 Provide a REST API for submitting and tracking status of jobs
• links to: [Github] Pull Request #4216 (andrewor14)