Hadoop YARN
  1. Hadoop YARN
  2. YARN-326

Add multi-resource scheduling to the fair scheduler

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.2-alpha
    • Fix Version/s: 2.1.0-beta
    • Component/s: scheduler
    • Labels:
    • Hadoop Flags:
      Reviewed

      Description

      With YARN-2 in, the capacity scheduler has the ability to schedule based on multiple resources, using dominant resource fairness. The fair scheduler should be able to do multiple resource scheduling as well, also using dominant resource fairness.

      More details to come on how the corner cases with fair scheduler configs such as min and max resources will be handled.

      1. YARN-326-8.patch
        88 kB
        Sandy Ryza
      2. YARN-326-7.patch
        88 kB
        Sandy Ryza
      3. YARN-326-6.patch
        82 kB
        Sandy Ryza
      4. YARN-326-5.patch
        82 kB
        Sandy Ryza
      5. YARN-326-4.patch
        80 kB
        Sandy Ryza
      6. YARN-326-3.patch
        80 kB
        Sandy Ryza
      7. YARN-326-2.patch
        73 kB
        Sandy Ryza
      8. YARN-326-1.patch
        53 kB
        Sandy Ryza
      9. YARN-326-1.patch
        53 kB
        Sandy Ryza
      10. FairSchedulerDRFDesignDoc-1.pdf
        83 kB
        Sandy Ryza
      11. YARN-326.patch
        52 kB
        Sandy Ryza
      12. YARN-326.patch
        46 kB
        Sandy Ryza
      13. FairSchedulerDRFDesignDoc.pdf
        78 kB
        Sandy Ryza

        Issue Links

          Activity

          Steve Loughran made changes -
          Link This issue is depended upon by YARN-896 [ YARN-896 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Alejandro Abdelnur made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 2.1.0-beta [ 12324029 ]
          Resolution Fixed [ 1 ]
          Sandy Ryza made changes -
          Attachment YARN-326-8.patch [ 12585890 ]
          Sandy Ryza made changes -
          Attachment YARN-326-7.patch [ 12585675 ]
          Sandy Ryza made changes -
          Labels incompatible
          Sandy Ryza made changes -
          Attachment YARN-326-6.patch [ 12585656 ]
          Sandy Ryza made changes -
          Attachment YARN-326-5.patch [ 12585511 ]
          Sandy Ryza made changes -
          Link This issue is depended upon by YARN-736 [ YARN-736 ]
          Sandy Ryza made changes -
          Attachment YARN-326-4.patch [ 12585300 ]
          Sandy Ryza made changes -
          Attachment YARN-326-3.patch [ 12585239 ]
          Sandy Ryza made changes -
          Link This issue is duplicated by YARN-350 [ YARN-350 ]
          Sandy Ryza made changes -
          Attachment YARN-326-2.patch [ 12581638 ]
          Sandy Ryza made changes -
          Attachment YARN-326-2.patch [ 12581636 ]
          Sandy Ryza made changes -
          Attachment YARN-326-2.patch [ 12581636 ]
          Sandy Ryza made changes -
          Attachment YARN-326-1.patch [ 12581061 ]
          Sandy Ryza made changes -
          Attachment YARN-326-1.patch [ 12581014 ]
          Sandy Ryza made changes -
          Attachment FairSchedulerDRFDesignDoc-1.pdf [ 12581004 ]
          Sandy Ryza made changes -
          Attachment YARN-326.patch [ 12580624 ]
          Sandy Ryza made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Sandy Ryza made changes -
          Attachment YARN-326.patch [ 12580557 ]
          Sandy Ryza made changes -
          Attachment YARN-326.patch [ 12580560 ]
          Sandy Ryza made changes -
          Attachment FairSchedulerDRFDesignDoc.pdf [ 12580559 ]
          Sandy Ryza made changes -
          Attachment YARN-326.patch [ 12580557 ]
          Eli Collins made changes -
          Link This issue is blocked by YARN-2 [ YARN-2 ]
          Sandy Ryza made changes -
          Issue Type Bug [ 1 ] New Feature [ 2 ]
          Karthik Kambatla (Inactive) made changes -
          Field Original Value New Value
          Link This issue is duplicated by YARN-327 [ YARN-327 ]
          Sandy Ryza created issue -

            People

            • Assignee:
              Sandy Ryza
              Reporter:
              Sandy Ryza
            • Votes:
              0 Vote for this issue
              Watchers:
              18 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development