Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7812

Improvements to Rich Placement Constraints in YARN

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None
    • Hide
      Further functionality and usability improvements over placement constraints, which includes:
      1. Support both intra-app and inter-app placement constraints
      2. Support composite placement constraints, such as AND/OR expressions
      3. Integrate placement constraint checks into Capacity Scheduler
      Show
      Further functionality and usability improvements over placement constraints, which includes: 1. Support both intra-app and inter-app placement constraints 2. Support composite placement constraints, such as AND/OR expressions 3. Integrate placement constraint checks into Capacity Scheduler

    Description

      This umbrella tracks the efforts for supporting following features

      1. Inter-app placement constraints
      2. Composite placement constraints, such as AND/OR expressions
      3. Support placement constraints in Capacity Scheduler

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. YARN-8731 Rich Placement constraints optimization and enhancements

          • Major - Major loss of function.
          • Reopened
          relates to

          New Feature - A new feature of the product, which has yet to be developed. YARN-6592 [Umbrella] Rich placement constraints in YARN

          • Major - Major loss of function.
          • Resolved
          1.
          		 Constraint satisfaction checker support for composite OR and AND constraints Sub-task Resolved Weiwei Yang
          2.
          		 Modify PlacementAlgorithm to Check node capacity before placing request on node Sub-task Resolved Panagiotis Garefalakis
          3.
          		 Merging of placement constraints defined at different levels Sub-task Resolved Weiwei Yang
          4.
          		 Support AND/OR constraints in Distributed Shell Sub-task Resolved Weiwei Yang
          5.
          		 Simplify configuration for PlacementConstraints Sub-task Resolved Wangda Tan
          6.
          		 Transform a PlacementConstraint to a string expression Sub-task Resolved Weiwei Yang
          7.
          		 Add .vm extension to PlacementConstraints.md to ensure proper filtering Sub-task Resolved Weiwei Yang
          8.
          		 Support inter-app placement constraints for allocation tags by application ID Sub-task Resolved Weiwei Yang
          9.
          		 Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator Sub-task Resolved Sunil G
          10.
          		 Constraint satisfaction checker support for inter-app constraints Sub-task Resolved Unassigned
          11.
          		 Support special Node Attribute scopes in addition to NODE and RACK Sub-task Resolved Weiwei Yang
          12.
          		 Support NOT_SELF and ALL namespace types for allocation tag Sub-task Resolved Weiwei Yang
          13.
          		 Admin command to manage global placement constraints Sub-task Resolved Weiwei Yang
          14.
          		 Support application tags when defining application namespaces for placement constraints Sub-task Resolved Weiwei Yang
          15.
          		 Support all types of placement constraint support for Capacity Scheduler Sub-task Resolved Weiwei Yang
          16.
          		 Simplify PlacementConstraints API by removing allocationTagToIntraApp Sub-task Resolved Weiwei Yang
          17.
          		 Update placement constraints doc with application namespaces and inter-app constraints Sub-task Resolved Weiwei Yang
          18.
          		 Fix constraint cardinality check in the presence of multiple target allocation tags Sub-task Resolved Weiwei Yang
          19.
          		 Add more E2E tests for placement constraints Sub-task Resolved Weiwei Yang

          Activity

            People

              Unassigned Unassigned
              asuresh Arun Suresh
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: