Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-397 RM Scheduler api enhancements
  3. YARN-1042

add ability to specify affinity/anti-affinity in container requests

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: None
    • Component/s: resourcemanager
    • Labels:
      None

      Description

      container requests to the AM should be able to request anti-affinity to ensure that things like Region Servers don't come up on the same failure zones.

      Similarly, you may be able to want to specify affinity to same host or rack without specifying which specific host/rack. Example: bringing up a small giraph cluster in a large YARN cluster would benefit from having the processes in the same rack purely for bandwidth reasons.

        Attachments

        1. YARN-1042.001.patch
          54 kB
          Weiwei Yang
        2. YARN-1042.002.patch
          57 kB
          Weiwei Yang
        3. YARN-1042-demo.patch
          15 kB
          Junping Du
        4. YARN-1042-design-doc.pdf
          68 kB
          Weiwei Yang
        5. YARN-1042-global-scheduling.poc.1.patch
          60 kB
          Wangda Tan

          Issue Links

            Activity

              People

              • Assignee:
                leftnoteasy Wangda Tan
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                5 Vote for this issue
                Watchers:
                59 Start watching this issue

                Dates

                • Created:
                  Updated: