Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-397 RM Scheduler api enhancements
  3. YARN-1042

add ability to specify affinity/anti-affinity in container requests

Add voteVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.0.0-alpha1
    • None
    • resourcemanager
    • None

    Description

      container requests to the AM should be able to request anti-affinity to ensure that things like Region Servers don't come up on the same failure zones.

      Similarly, you may be able to want to specify affinity to same host or rack without specifying which specific host/rack. Example: bringing up a small giraph cluster in a large YARN cluster would benefit from having the processes in the same rack purely for bandwidth reasons.

      Attachments

        1. YARN-1042-demo.patch
          15 kB
          Junping Du
        2. YARN-1042-design-doc.pdf
          68 kB
          Weiwei Yang
        3. YARN-1042.001.patch
          54 kB
          Weiwei Yang
        4. YARN-1042.002.patch
          57 kB
          Weiwei Yang
        5. YARN-1042-global-scheduling.poc.1.patch
          60 kB
          Wangda Tan

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            leftnoteasy Wangda Tan
            stevel@apache.org Steve Loughran

            Dates

              Created:
              Updated:

              Slack

                Issue deployment