Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-10288

Add a rest client for Spark on Yarn

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • None
    • None
    • YARN

    Description

      This is a proposal to add rest client for Spark on Yarn. Rest API offers a convenient addition to let user to submit application through rest client, people will easily achieve long haul submission, build their own submission gateway through rest client.

      Here is the design doc (https://docs.google.com/document/d/1m_P-4olXrp0tJ3kEOLZh1rwrjTfAat7P3fAVPR5GTmg/edit?usp=sharing).

      Currently I'm working on it, working branch is (https://github.com/jerryshao/apache-spark/tree/yarn-rest-support), the major part is already finished.

      Any comment is greatly appreciated, thanks a lot.

      Attachments

        Activity

          People

            Unassigned Unassigned
            jerryshao Saisai Shao
            Votes:
            1 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: