Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2877 Extend YARN to support distributed scheduling
  3. YARN-4412

Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers

    XMLWordPrintableJSON

Details

    Description

      Introduce a Cluster Monitor that aggregates load information from individual Node Managers and computes an ordered list of preferred Node managers to be used as target Nodes for OPPORTUNISTIC container allocations.

      This list can be pushed out to the Node Manager (specifically the AMRMProxy running on the Node) via the Allocate Response. This will be used to make local Scheduling decisions

      Attachments

        1. YARN-4412.007.patch
          110 kB
          Arun Suresh
        2. YARN-4412.008.patch
          81 kB
          Arun Suresh
        3. YARN-4412.009.patch
          79 kB
          Arun Suresh
        4. YARN-4412.addendum-001.patch
          7 kB
          Arun Suresh
        5. YARN-4412.find-bugs.patch
          0.7 kB
          Arun Suresh
        6. YARN-4412-yarn-2877.v1.patch
          79 kB
          Arun Suresh
        7. YARN-4412-yarn-2877.v2.patch
          80 kB
          Arun Suresh
        8. YARN-4412-yarn-2877.v3.patch
          100 kB
          Arun Suresh
        9. YARN-4412-yarn-2877.v4.patch
          110 kB
          Arun Suresh
        10. YARN-4412-yarn-2877.v5.patch
          117 kB
          Arun Suresh
        11. YARN-4412-yarn-2877.v6.patch
          118 kB
          Arun Suresh

        Issue Links

          breaks

          Sub-task - The sub-task of the issue YARN-5075 Fix findbugs warning in hadoop-yarn-common module

          • Major - Major loss of function.
          • Resolved
          contains

          Sub-task - The sub-task of the issue YARN-4992 Fix miscellaneous testcase errors due to YARN-2885

          • Major - Major loss of function.
          • Resolved
          duplicates

          Sub-task - The sub-task of the issue YARN-5075 Fix findbugs warning in hadoop-yarn-common module

          • Major - Major loss of function.
          • Resolved
          is blocked by

          Sub-task - The sub-task of the issue YARN-2885 Create AMRMProxy request interceptor for distributed scheduling decisions for queueable containers

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue YARN-2883 Queuing of container requests in the NM

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              asuresh Arun Suresh
              asuresh Arun Suresh
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: