Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4752

FairScheduler should preempt for a ResourceRequest and all preempted containers should be on the same node

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.9.0, 3.0.0-alpha2
    • Component/s: fairscheduler
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      A number of issues have been reported with respect to preemption in FairScheduler along the lines of:

      1. FairScheduler preempts resources from nodes even if the resultant free resources cannot fit the incoming request.
      2. Preemption doesn't preempt from sibling queues
      3. Preemption doesn't preempt from sibling apps under the same queue that is over its fairshare
      4. ...

      Filing this umbrella JIRA to group all the issues together and think of a comprehensive solution.

        Attachments

        1. yarn-6076-branch-2.1.patch
          182 kB
          Karthik Kambatla
        2. yarn-4752.4.patch
          181 kB
          Karthik Kambatla
        3. yarn-4752.4.patch
          181 kB
          Karthik Kambatla
        4. yarn-4752.3.patch
          182 kB
          Karthik Kambatla
        5. yarn-4752.2.patch
          167 kB
          Karthik Kambatla
        6. yarn-4752-1.patch
          164 kB
          Karthik Kambatla
        7. YARN-4752.FairSchedulerPreemptionOverhaul.pdf
          59 kB
          Karthik Kambatla

        Issue Links

          Activity

            People

            • Assignee:
              kasha Karthik Kambatla
              Reporter:
              kasha Karthik Kambatla

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment