Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7812 Improvements to Rich Placement Constraints in YARN
  3. YARN-7778

Merging of placement constraints defined at different levels

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.1.0
    • None
    • None

    Description

      When we have multiple constraints defined for a given set of allocation tags at different levels (i.e., at the cluster, the application or the scheduling request level), we need to merge those constraints.

      Defining constraint levels as cluster > application > scheduling request, constraints defined at lower levels should only be more restrictive than those of higher levels. Otherwise the allocation should fail.

      For example, if there is an application level constraint that allows no more than 5 HBase containers per rack, a scheduling request can further restrict that to 3 containers per rack but not to 7 containers per rack.

      Attachments

        1. Merge Constraints Solution.pdf
          68 kB
          Weiwei Yang
        2. YARN-7778.003.patch
          14 kB
          Weiwei Yang
        3. YARN-7778.004.patch
          14 kB
          Weiwei Yang
        4. YARN-7778-YARN-7812.001.patch
          13 kB
          Weiwei Yang
        5. YARN-7778-YARN-7812.002.patch
          15 kB
          Weiwei Yang

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            cheersyang Weiwei Yang
            kkaranasos Konstantinos Karanasos
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment