Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-45 [Preemption] Scheduler feedback to AM to release containers
  3. YARN-1957

ProportionalCapacitPreemptionPolicy handling of corner cases...

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      The current version of ProportionalCapacityPreemptionPolicy should be improved to deal with the following two scenarios:
      1) when rebalancing over-capacity allocations, it potentially preempts without considering the maxCapacity constraints of a queue (i.e., preempting possibly more than strictly necessary)
      2) a zero capacity queue is preempted even if there is no demand (coherent with old use of zero-capacity to disabled queues)

      The proposed patch fixes both issues, and introduce few new test cases.

        Attachments

        1. YARN-1957.patch
          20 kB
          Carlo Curino
        2. YARN-1957_test.patch
          10 kB
          Carlo Curino
        3. YARN-1957.patch
          11 kB
          Carlo Curino

          Activity

            People

            • Assignee:
              curino Carlo Curino
              Reporter:
              curino Carlo Curino
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: