Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-326

Add multi-resource scheduling to the fair scheduler

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.2-alpha
    • Fix Version/s: 2.1.0-beta
    • Component/s: scheduler
    • Labels:
    • Hadoop Flags:
      Reviewed

      Description

      With YARN-2 in, the capacity scheduler has the ability to schedule based on multiple resources, using dominant resource fairness. The fair scheduler should be able to do multiple resource scheduling as well, also using dominant resource fairness.

      More details to come on how the corner cases with fair scheduler configs such as min and max resources will be handled.

        Attachments

        1. YARN-326-8.patch
          88 kB
          Sandy Ryza
        2. YARN-326-7.patch
          88 kB
          Sandy Ryza
        3. YARN-326-6.patch
          82 kB
          Sandy Ryza
        4. YARN-326-5.patch
          82 kB
          Sandy Ryza
        5. YARN-326-4.patch
          80 kB
          Sandy Ryza
        6. YARN-326-3.patch
          80 kB
          Sandy Ryza
        7. YARN-326-2.patch
          73 kB
          Sandy Ryza
        8. YARN-326-1.patch
          53 kB
          Sandy Ryza
        9. YARN-326-1.patch
          53 kB
          Sandy Ryza
        10. YARN-326.patch
          46 kB
          Sandy Ryza
        11. YARN-326.patch
          52 kB
          Sandy Ryza
        12. FairSchedulerDRFDesignDoc-1.pdf
          83 kB
          Sandy Ryza
        13. FairSchedulerDRFDesignDoc.pdf
          78 kB
          Sandy Ryza

          Issue Links

            Activity

              People

              • Assignee:
                sandyr Sandy Ryza
                Reporter:
                sandyr Sandy Ryza
              • Votes:
                0 Vote for this issue
                Watchers:
                18 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: