[SPARK-16532] Provide a REST API for submitting and tracking status of jobs

• Type: Brainstorming
• Status: Resolved
• Priority: Minor
• Resolution: Incomplete
• Affects Version/s: 1.6.0
• Component/s: Documentation, Spark Core
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Joao Vasques
• Created: 13/Jul/16 20:21
• Updated: 21/May/19 04:34
• Resolved: 21/May/19 04:34

Description

When I was looking at the Spark Master dashboard I noticed the existence of a REST URL. After searching a bit I found there was a non-documented REST API that allows me to submit jobs without using the spark-submit script and Launcher class https://spark.apache.org/docs/1.6.1/api/java/org/apache/spark/launcher/package-summary.html.

Why isn't this API publicly documented? Do you have any plans to have a REST API to submit and monitor job status?

Issue Links

• relates to: SPARK-5388 Provide a stable application submission gateway in standalone cluster mode