Details
-
New Feature
-
Status: Resolved
-
Major
-
Resolution: Incomplete
-
None
-
None
Description
This is a proposal to add rest client for Spark on Yarn. Rest API offers a convenient addition to let user to submit application through rest client, people will easily achieve long haul submission, build their own submission gateway through rest client.
Here is the design doc (https://docs.google.com/document/d/1m_P-4olXrp0tJ3kEOLZh1rwrjTfAat7P3fAVPR5GTmg/edit?usp=sharing).
Currently I'm working on it, working branch is (https://github.com/jerryshao/apache-spark/tree/yarn-rest-support), the major part is already finished.
Any comment is greatly appreciated, thanks a lot.