Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3306 [Umbrella] Proposing per-queue Policy driven scheduling in YARN
  3. YARN-3510

Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • yarn
    • None

    Description

      The ProportionalCapacityPreemptionPolicy preempts as many containers from applications as it can during it's preemption run. For fifo this makes sense, as it is prempting in reverse order & therefore maintaining the primacy of the "oldest". For fair ordering this does not have the desired effect - instead, it should preempt a number of containers from each application which maintains a fair balance /close to a fair balance between them

      Attachments

        1. YARN-3510.2.patch
          10 kB
          Craig Welch
        2. YARN-3510.3.patch
          9 kB
          Craig Welch
        3. YARN-3510.5.patch
          9 kB
          Craig Welch
        4. YARN-3510.6.patch
          9 kB
          Craig Welch

        Issue Links

          is related to

          Sub-task - The sub-task of the issue YARN-4108 CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue YARN-3319 Implement a FairOrderingPolicy

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              leftnoteasy Wangda Tan
              cwelch Craig Welch
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: