Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7812

Improvements to Rich Placement Constraints in YARN

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Release Note:
      Hide
      Further functionality and usability improvements over placement constraints, which includes:
      1. Support both intra-app and inter-app placement constraints
      2. Support composite placement constraints, such as AND/OR expressions
      3. Integrate placement constraint checks into Capacity Scheduler
      Show
      Further functionality and usability improvements over placement constraints, which includes: 1. Support both intra-app and inter-app placement constraints 2. Support composite placement constraints, such as AND/OR expressions 3. Integrate placement constraint checks into Capacity Scheduler

      Description

      This umbrella tracks the efforts for supporting following features

      1. Inter-app placement constraints
      2. Composite placement constraints, such as AND/OR expressions
      3. Support placement constraints in Capacity Scheduler

        Attachments

          Issue Links

          1.
          Constraint satisfaction checker support for composite OR and AND constraints Sub-task Resolved Weiwei Yang
          2.
          Modify PlacementAlgorithm to Check node capacity before placing request on node Sub-task Resolved Panagiotis Garefalakis
          3.
          Merging of placement constraints defined at different levels Sub-task Resolved Weiwei Yang
          4.
          Support AND/OR constraints in Distributed Shell Sub-task Resolved Weiwei Yang
          5.
          Simplify configuration for PlacementConstraints Sub-task Resolved Wangda Tan
          6.
          Transform a PlacementConstraint to a string expression Sub-task Resolved Weiwei Yang
          7.
          Add .vm extension to PlacementConstraints.md to ensure proper filtering Sub-task Resolved Weiwei Yang
          8.
          Support inter-app placement constraints for allocation tags by application ID Sub-task Resolved Weiwei Yang
          9.
          Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator Sub-task Resolved Sunil G
          10.
          Constraint satisfaction checker support for inter-app constraints Sub-task Resolved Unassigned
          11.
          Support special Node Attribute scopes in addition to NODE and RACK Sub-task Resolved Weiwei Yang
          12.
          Support NOT_SELF and ALL namespace types for allocation tag Sub-task Resolved Weiwei Yang
          13.
          Admin command to manage global placement constraints Sub-task Resolved Weiwei Yang
          14.
          Support application tags when defining application namespaces for placement constraints Sub-task Resolved Weiwei Yang
          15.
          Support all types of placement constraint support for Capacity Scheduler Sub-task Resolved Weiwei Yang
          16.
          Simplify PlacementConstraints API by removing allocationTagToIntraApp Sub-task Resolved Weiwei Yang
          17.
          Update placement constraints doc with application namespaces and inter-app constraints Sub-task Resolved Weiwei Yang
          18.
          Fix constraint cardinality check in the presence of multiple target allocation tags Sub-task Resolved Weiwei Yang
          19.
          Add more E2E tests for placement constraints Sub-task Resolved Weiwei Yang

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                asuresh Arun Suresh
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: