Hadoop YARN
  1. Hadoop YARN
  2. YARN-2

Enhance CS to schedule accounting for both memory and cpu cores

    Details

      Description

      With YARN being a general purpose system, it would be useful for several applications (MPI et al) to specify not just memory but also CPU (cores) for their resource requirements. Thus, it would be useful to the CapacityScheduler to account for both.

      1. MAPREDUCE-4327.patch
        57 kB
        Arun C Murthy
      2. MAPREDUCE-4327-v2.patch
        60 kB
        Andrew Ferguson
      3. MAPREDUCE-4327-v3.patch
        67 kB
        Andrew Ferguson
      4. MAPREDUCE-4327-v4.patch
        70 kB
        Andrew Ferguson
      5. MAPREDUCE-4327-v5.patch
        361 kB
        Andrew Ferguson
      6. MAPREDUCE-4327.patch
        100 kB
        Arun C Murthy
      7. MAPREDUCE-4327.patch
        148 kB
        Arun C Murthy
      8. YARN-2.patch
        147 kB
        Arun C Murthy
      9. YARN-2-help.patch
        7 kB
        Junping Du
      10. YARN-2.patch
        149 kB
        Arun C Murthy
      11. YARN-2.patch
        153 kB
        Arun C Murthy
      12. YARN-2.patch
        162 kB
        Arun C Murthy
      13. YARN-2.patch
        148 kB
        Arun C Murthy
      14. YARN-2.patch
        170 kB
        Arun C Murthy
      15. YARN-2.patch
        170 kB
        Arun C Murthy
      16. YARN-2.patch
        174 kB
        Arun C Murthy
      17. YARN-2.patch
        178 kB
        Arun C Murthy
      18. YARN-2.patch
        178 kB
        Arun C Murthy
      19. YARN-2.patch
        180 kB
        Arun C Murthy
      20. YARN-2.patch
        180 kB
        Arun C Murthy
      21. YARN-2.patch
        180 kB
        Arun C Murthy

        Issue Links

          Activity

          Gavin made changes -
          Link This issue is depended upon by YARN-294 [ YARN-294 ]
          Gavin made changes -
          Link This issue blocks YARN-294 [ YARN-294 ]
          Gavin made changes -
          Link This issue is depended upon by YARN-5 [ YARN-5 ]
          Gavin made changes -
          Link This issue blocks YARN-5 [ YARN-5 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Eli Collins made changes -
          Link This issue blocks YARN-326 [ YARN-326 ]
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arun C Murthy made changes -
          Attachment YARN-2.patch [ 12563877 ]
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arun C Murthy made changes -
          Attachment YARN-2.patch [ 12563741 ]
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arun C Murthy made changes -
          Attachment YARN-2.patch [ 12563582 ]
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arun C Murthy made changes -
          Attachment YARN-2.patch [ 12562662 ]
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arun C Murthy made changes -
          Attachment YARN-2.patch [ 12562653 ]
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arun C Murthy made changes -
          Attachment YARN-2.patch [ 12562651 ]
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arun C Murthy made changes -
          Attachment YARN-2.patch [ 12562579 ]
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Karthik Kambatla made changes -
          Link This issue blocks YARN-294 [ YARN-294 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arun C Murthy made changes -
          Attachment YARN-2.patch [ 12562490 ]
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arun C Murthy made changes -
          Attachment YARN-2.patch [ 12562310 ]
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arun C Murthy made changes -
          Attachment YARN-2.patch [ 12562305 ]
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Radim Kolar made changes -
          Link This issue blocks MAPREDUCE-4256 [ MAPREDUCE-4256 ]
          Radim Kolar made changes -
          Link This issue blocks YARN-5 [ YARN-5 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arun C Murthy made changes -
          Attachment YARN-2.patch [ 12549459 ]
          Alejandro Abdelnur made changes -
          Link This issue is related to YARN-160 [ YARN-160 ]
          Arun C Murthy made changes -
          Fix Version/s 2.0.3-alpha [ 12323272 ]
          Fix Version/s 2.0.2-alpha [ 12322548 ]
          Arun C Murthy made changes -
          Fix Version/s 2.0.2-alpha [ 12322548 ]
          Fix Version/s 2.1.0-alpha [ 12322547 ]
          Gavin made changes -
          Workflow jira [ 12719390 ] no-reopen-closed, patch-avail [ 12722162 ]
          Arun C Murthy made changes -
          Attachment YARN-2.patch [ 12541718 ]
          Junping Du made changes -
          Attachment YARN-2-help.patch [ 12540841 ]
          Karthik Kambatla made changes -
          Link This issue incorporates YARN-21 [ YARN-21 ]
          Arun C Murthy made changes -
          Attachment YARN-2.patch [ 12539778 ]
          Arun C Murthy made changes -
          Link This issue blocks MAPREDUCE-4520 [ MAPREDUCE-4520 ]
          Arun C Murthy made changes -
          Fix Version/s 2.1.0-alpha [ 12322547 ]
          Component/s capacityscheduler [ 12319324 ]
          Component/s scheduler [ 12319325 ]
          Arun C Murthy made changes -
          Project Hadoop Map/Reduce [ 12310941 ] Hadoop YARN [ 12313722 ]
          Key MAPREDUCE-4327 YARN-2
          Workflow no-reopen-closed, patch-avail [ 12672520 ] jira [ 12719390 ]
          Status Patch Available [ 10002 ] Open [ 1 ]
          Release Note Add support to YARN for CPU scheduling
          Affects Version/s 2.0.0-alpha [ 12320354 ]
          Target Version/s 2.1.0-alpha [ 12321442 ]
          Component/s mrv2 [ 12314301 ]
          Component/s resourcemanager [ 12315340 ]
          Component/s scheduler [ 12315345 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arun C Murthy made changes -
          Attachment MAPREDUCE-4327.patch [ 12538848 ]
          Jeff Hammerbacher made changes -
          Link This issue relates to MAPREDUCE-4334 [ MAPREDUCE-4334 ]
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Arun C Murthy made changes -
          Link This issue blocks MAPREDUCE-4476 [ MAPREDUCE-4476 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arun C Murthy made changes -
          Attachment MAPREDUCE-4327.patch [ 12537740 ]
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Assignee Andrew Ferguson [ adferguson ] Arun C Murthy [ acmurthy ]
          Andrew Ferguson made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Release Note Add support to YARN for CPU scheduling
          Assignee Arun C Murthy [ acmurthy ] Andrew Ferguson [ adferguson ]
          Andrew Ferguson made changes -
          Attachment MAPREDUCE-4327-v5.patch [ 12535445 ]
          Andrew Ferguson made changes -
          Attachment MAPREDUCE-4327-v4.patch [ 12533153 ]
          Andrew Ferguson made changes -
          Attachment MAPREDUCE-4327-v3.patch [ 12533147 ]
          Andrew Ferguson made changes -
          Attachment MAPREDUCE-4327-v2.patch [ 12533079 ]
          Karthik Kambatla made changes -
          Link This issue relates to MAPREDUCE-4257 [ MAPREDUCE-4257 ]
          Arun C Murthy made changes -
          Field Original Value New Value
          Attachment MAPREDUCE-4327.patch [ 12531375 ]
          Arun C Murthy created issue -

            People

            • Assignee:
              Arun C Murthy
              Reporter:
              Arun C Murthy
            • Votes:
              0 Vote for this issue
              Watchers:
              47 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development