Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7812 Improvements to Rich Placement Constraints in YARN
  3. YARN-7839

Modify PlacementAlgorithm to Check node capacity before placing request on node

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.1.0
    • None
    • None

    Description

      Currently, the Algorithm assigns a node to a request purely based on if the constraints are met. It is later in the scheduling phase that the Queue capacity and Node capacity are checked. If the request cannot be placed because of unavailable Queue/Node capacity, the request is retried by the Algorithm.

      For clusters that are running at high utilization, we can reduce the retries if we perform the Node capacity check in the Algorithm as well. The Queue capacity check and the other user limit checks can still be handled by the scheduler (since queues and other limits are tied to the scheduler, and not scheduler agnostic)

      Attachments

        1. YARN-7839-YARN-6592.001.patch
          29 kB
          Panagiotis Garefalakis

        Activity

          People

            pgaref Panagiotis Garefalakis
            asuresh Arun Suresh
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: