Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4752

FairScheduler should preempt for a ResourceRequest and all preempted containers should be on the same node

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.8.0
    • 2.9.0, 3.0.0-alpha2
    • fairscheduler
    • None
    • Reviewed

    Description

      A number of issues have been reported with respect to preemption in FairScheduler along the lines of:

      1. FairScheduler preempts resources from nodes even if the resultant free resources cannot fit the incoming request.
      2. Preemption doesn't preempt from sibling queues
      3. Preemption doesn't preempt from sibling apps under the same queue that is over its fairshare
      4. ...

      Filing this umbrella JIRA to group all the issues together and think of a comprehensive solution.

      Attachments

        1. yarn-4752.2.patch
          167 kB
          Karthik Kambatla
        2. yarn-4752.3.patch
          182 kB
          Karthik Kambatla
        3. yarn-4752.4.patch
          181 kB
          Karthik Kambatla
        4. yarn-4752.4.patch
          181 kB
          Karthik Kambatla
        5. YARN-4752.FairSchedulerPreemptionOverhaul.pdf
          59 kB
          Karthik Kambatla
        6. yarn-4752-1.patch
          164 kB
          Karthik Kambatla
        7. yarn-6076-branch-2.1.patch
          182 kB
          Karthik Kambatla

        Issue Links

          Activity

            People

              kasha Karthik Kambatla
              kasha Karthik Kambatla
              Votes:
              1 Vote for this issue
              Watchers:
              28 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: