Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2877 Extend YARN to support distributed scheduling
  3. YARN-2885

Create AMRMProxy request interceptor for distributed scheduling decisions for queueable containers

    XMLWordPrintableJSON

Details

    Description

      We propose to add a Local ResourceManager (LocalRM) to the NM in order to support distributed scheduling decisions.
      Architecturally we leverage the RMProxy, introduced in YARN-2884.
      The LocalRM makes distributed decisions for queuable containers requests.
      Guaranteed-start requests are still handled by the central RM.

      Attachments

        1. YARN-2885_api_changes.patch
          12 kB
          Arun Suresh
        2. YARN-2885.010.patch
          166 kB
          Arun Suresh
        3. YARN-2885.011.patch
          155 kB
          Arun Suresh
        4. YARN-2885.012.patch
          155 kB
          Arun Suresh
        5. YARN-2885-yarn-2877.001.patch
          105 kB
          Arun Suresh
        6. YARN-2885-yarn-2877.002.patch
          129 kB
          Arun Suresh
        7. YARN-2885-yarn-2877.full.patch
          172 kB
          Arun Suresh
        8. YARN-2885-yarn-2877.full-2.patch
          180 kB
          Arun Suresh
        9. YARN-2885-yarn-2877.full-3.patch
          183 kB
          Arun Suresh
        10. YARN-2885-yarn-2877.v4.patch
          139 kB
          Arun Suresh
        11. YARN-2885-yarn-2877.v5.patch
          141 kB
          Arun Suresh
        12. YARN-2885-yarn-2877.v6.patch
          149 kB
          Arun Suresh
        13. YARN-2885-yarn-2877.v7.patch
          151 kB
          Arun Suresh
        14. YARN-2885-yarn-2877.v8.patch
          152 kB
          Arun Suresh
        15. YARN-2885-yarn-2877.v9.patch
          152 kB
          Arun Suresh

        Issue Links

          blocks

          Sub-task - The sub-task of the issue YARN-4412 Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers

          • Major - Major loss of function.
          • Resolved
          is blocked by

          Sub-task - The sub-task of the issue YARN-2882 Add an OPPORTUNISTIC ExecutionType

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue YARN-5113 Refactoring and other clean-up for distributed scheduling

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              asuresh Arun Suresh
              kkaranasos Konstantinos Karanasos
              Votes:
              0 Vote for this issue
              Watchers:
              18 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: