Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4752

FairScheduler should preempt for a ResourceRequest and all preempted containers should be on the same node

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.9.0, 3.0.0-alpha2
    • Component/s: fairscheduler
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      A number of issues have been reported with respect to preemption in FairScheduler along the lines of:

      1. FairScheduler preempts resources from nodes even if the resultant free resources cannot fit the incoming request.
      2. Preemption doesn't preempt from sibling queues
      3. Preemption doesn't preempt from sibling apps under the same queue that is over its fairshare
      4. ...

      Filing this umbrella JIRA to group all the issues together and think of a comprehensive solution.

        Attachments

        1. yarn-6076-branch-2.1.patch
          182 kB
          Karthik Kambatla
        2. yarn-4752-1.patch
          164 kB
          Karthik Kambatla
        3. YARN-4752.FairSchedulerPreemptionOverhaul.pdf
          59 kB
          Karthik Kambatla
        4. yarn-4752.4.patch
          181 kB
          Karthik Kambatla
        5. yarn-4752.4.patch
          181 kB
          Karthik Kambatla
        6. yarn-4752.3.patch
          182 kB
          Karthik Kambatla
        7. yarn-4752.2.patch
          167 kB
          Karthik Kambatla

          Issue Links

            Activity

              People

              • Assignee:
                kasha Karthik Kambatla
                Reporter:
                kasha Karthik Kambatla
              • Votes:
                1 Vote for this issue
                Watchers:
                27 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: