Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7812 Improvements to Rich Placement Constraints in YARN
  3. YARN-7778

Merging of placement constraints defined at different levels

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.1.0
    • None
    • None

    Description

      When we have multiple constraints defined for a given set of allocation tags at different levels (i.e., at the cluster, the application or the scheduling request level), we need to merge those constraints.

      Defining constraint levels as cluster > application > scheduling request, constraints defined at lower levels should only be more restrictive than those of higher levels. Otherwise the allocation should fail.

      For example, if there is an application level constraint that allows no more than 5 HBase containers per rack, a scheduling request can further restrict that to 3 containers per rack but not to 7 containers per rack.

      Attachments

        1. Merge Constraints Solution.pdf
          68 kB
          Weiwei Yang
        2. YARN-7778-YARN-7812.001.patch
          13 kB
          Weiwei Yang
        3. YARN-7778-YARN-7812.002.patch
          15 kB
          Weiwei Yang
        4. YARN-7778.003.patch
          14 kB
          Weiwei Yang
        5. YARN-7778.004.patch
          14 kB
          Weiwei Yang

        Issue Links

          Activity

            People

              cheersyang Weiwei Yang
              kkaranasos Konstantinos Karanasos
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: