Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5907

[Umbrella] [YARN-1042] add ability to specify affinity/anti-affinity in container requests

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: None
    • Component/s: resourcemanager
    • Labels:
      None

      Description

      container requests to the AM should be able to request anti-affinity to ensure that things like Region Servers don't come up on the same failure zones.

      Similarly, you may be able to want to specify affinity to same host or rack without specifying which specific host/rack. Example: bringing up a small giraph cluster in a large YARN cluster would benefit from having the processes in the same rack purely for bandwidth reasons.


      This JIRA is cloned umbrella JIRA of YARN-1042, discussions / designs / POC patches, etc. please refer to YARN-1042.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                leftnoteasy Wangda Tan
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated: