Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2877 Extend YARN to support distributed scheduling
  3. YARN-4412

Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      Introduce a Cluster Monitor that aggregates load information from individual Node Managers and computes an ordered list of preferred Node managers to be used as target Nodes for OPPORTUNISTIC container allocations.

      This list can be pushed out to the Node Manager (specifically the AMRMProxy running on the Node) via the Allocate Response. This will be used to make local Scheduling decisions

      Attachments

        1. YARN-4412-yarn-2877.v6.patch
          118 kB
          Arun Suresh
        2. YARN-4412-yarn-2877.v5.patch
          117 kB
          Arun Suresh
        3. YARN-4412-yarn-2877.v4.patch
          110 kB
          Arun Suresh
        4. YARN-4412-yarn-2877.v3.patch
          100 kB
          Arun Suresh
        5. YARN-4412-yarn-2877.v2.patch
          80 kB
          Arun Suresh
        6. YARN-4412-yarn-2877.v1.patch
          79 kB
          Arun Suresh
        7. YARN-4412.find-bugs.patch
          0.7 kB
          Arun Suresh
        8. YARN-4412.addendum-001.patch
          7 kB
          Arun Suresh
        9. YARN-4412.009.patch
          79 kB
          Arun Suresh
        10. YARN-4412.008.patch
          81 kB
          Arun Suresh
        11. YARN-4412.007.patch
          110 kB
          Arun Suresh

        Issue Links

        breaks

        Sub-task - The sub-task of the issue YARN-5075 Fix findbugs warning in hadoop-yarn-common module

        • Major - Major loss of function.
        • Resolved
        contains

        Sub-task - The sub-task of the issue YARN-4992 Fix miscellaneous testcase errors due to YARN-2885

        • Major - Major loss of function.
        • Resolved
        duplicates

        Sub-task - The sub-task of the issue YARN-5075 Fix findbugs warning in hadoop-yarn-common module

        • Major - Major loss of function.
        • Resolved
        is blocked by

        Sub-task - The sub-task of the issue YARN-2885 Create AMRMProxy request interceptor for distributed scheduling decisions for queueable containers

        • Major - Major loss of function.
        • Resolved
        is related to

        Sub-task - The sub-task of the issue YARN-2883 Queuing of container requests in the NM

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            asuresh Arun Suresh
            asuresh Arun Suresh
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment