Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-326

Add multi-resource scheduling to the fair scheduler

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.2-alpha
    • 2.1.0-beta
    • scheduler
    • Reviewed

    Description

      With YARN-2 in, the capacity scheduler has the ability to schedule based on multiple resources, using dominant resource fairness. The fair scheduler should be able to do multiple resource scheduling as well, also using dominant resource fairness.

      More details to come on how the corner cases with fair scheduler configs such as min and max resources will be handled.

      Attachments

        1. FairSchedulerDRFDesignDoc.pdf
          78 kB
          Sandy Ryza
        2. FairSchedulerDRFDesignDoc-1.pdf
          83 kB
          Sandy Ryza
        3. YARN-326.patch
          52 kB
          Sandy Ryza
        4. YARN-326.patch
          46 kB
          Sandy Ryza
        5. YARN-326-1.patch
          53 kB
          Sandy Ryza
        6. YARN-326-1.patch
          53 kB
          Sandy Ryza
        7. YARN-326-2.patch
          73 kB
          Sandy Ryza
        8. YARN-326-3.patch
          80 kB
          Sandy Ryza
        9. YARN-326-4.patch
          80 kB
          Sandy Ryza
        10. YARN-326-5.patch
          82 kB
          Sandy Ryza
        11. YARN-326-6.patch
          82 kB
          Sandy Ryza
        12. YARN-326-7.patch
          88 kB
          Sandy Ryza
        13. YARN-326-8.patch
          88 kB
          Sandy Ryza

        Issue Links

          Activity

            People

              sandyr Sandy Ryza
              sandyr Sandy Ryza
              Votes:
              0 Vote for this issue
              Watchers:
              18 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: