[SPARK-12528] Make Apache Spark’s gateway hidden REST API (in standalone cluster mode) public API

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Incomplete
• Affects Version/s: 2.0.0
• Component/s: Deploy
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Youcef HILEM
• Created: 26/Dec/15 08:55
• Updated: 21/May/19 04:37
• Resolved: 21/May/19 04:37

Description

Spark has a hidden REST API which handles application submission, status checking and cancellation (https://issues.apache.org/jira/browse/SPARK-5388).
There is enough interest using this API to justify making it public :

• https://github.com/ywilkof/spark-jobs-rest-client
• https://github.com/yohanliyanage/jenkins-spark-deploy
• https://github.com/spark-jobserver/spark-jobserver
• http://stackoverflow.com/questions/28992802/triggering-spark-jobs-with-rest
• http://stackoverflow.com/questions/34225879/how-to-submit-a-job-via-rest-api
• http://arturmkrtchyan.com/apache-spark-hidden-rest-api