Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-326

Add multi-resource scheduling to the fair scheduler

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.2-alpha
    • 2.1.0-beta
    • scheduler
    • Reviewed

    Description

      With YARN-2 in, the capacity scheduler has the ability to schedule based on multiple resources, using dominant resource fairness. The fair scheduler should be able to do multiple resource scheduling as well, also using dominant resource fairness.

      More details to come on how the corner cases with fair scheduler configs such as min and max resources will be handled.

      Attachments

        1. FairSchedulerDRFDesignDoc.pdf
          78 kB
          Sandy Ryza
        2. FairSchedulerDRFDesignDoc-1.pdf
          83 kB
          Sandy Ryza
        3. YARN-326.patch
          52 kB
          Sandy Ryza
        4. YARN-326.patch
          46 kB
          Sandy Ryza
        5. YARN-326-1.patch
          53 kB
          Sandy Ryza
        6. YARN-326-1.patch
          53 kB
          Sandy Ryza
        7. YARN-326-2.patch
          73 kB
          Sandy Ryza
        8. YARN-326-3.patch
          80 kB
          Sandy Ryza
        9. YARN-326-4.patch
          80 kB
          Sandy Ryza
        10. YARN-326-5.patch
          82 kB
          Sandy Ryza
        11. YARN-326-6.patch
          82 kB
          Sandy Ryza
        12. YARN-326-7.patch
          88 kB
          Sandy Ryza
        13. YARN-326-8.patch
          88 kB
          Sandy Ryza

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sandyr Sandy Ryza
            sandyr Sandy Ryza
            Votes:
            0 Vote for this issue
            Watchers:
            18 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment