Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1963

Support priorities across applications within the same queue

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: api, resourcemanager
    • Labels:
      None

      Description

      It will be very useful to support priorities among applications within the same queue, particularly in production scenarios. It allows for finer-grained controls without having to force admins to create a multitude of queues, plus allows existing applications to continue using existing queues which are usually part of institutional memory.

        Attachments

        1. YARN Application Priorities Design.pdf
          179 kB
          Sunil Govindan
        2. YARN Application Priorities Design_01.pdf
          178 kB
          Sunil Govindan
        3. 0001-YARN-1963-prototype.patch
          84 kB
          Sunil Govindan
        4. YARN Application Priorities Design _02.pdf
          117 kB
          Sunil Govindan

          Issue Links

          1.
          Support for Application priority : Changes in RM and Capacity Scheduler Sub-task Resolved Sunil Govindan
          2.
          Priority scheduling support in Capacity scheduler Sub-task Resolved Sunil Govindan
          3.
          User level API support for priority label Sub-task Resolved Rohith Sharma K S
          4.
          Priority Label Manager in RM to manage application priority based on configuration Sub-task Resolved Sunil Govindan
          5.
          Server side PB changes for Priority Label Manager and Admin CLI support Sub-task Resolved Sunil Govindan
          6.
          Support admin cli interface in for Application Priority Sub-task Resolved Rohith Sharma K S
          7.
          FIFO scheduler doesn't respect changing job priority Sub-task Resolved Rohith Sharma K S
          8.
          Support for changing Application priority during runtime Sub-task Resolved Sunil Govindan
          9.
          Display Application Priority in RM Web UI Sub-task Resolved Sunil Govindan
          10.
          Support for application priority ACLs in queues of CapacityScheduler Sub-task Resolved Sunil Govindan
          11.
          REST api support for Application Priority Sub-task Resolved Naganarasimha G R
          12.
          Support user cli interface in for Application Priority Sub-task Resolved Rohith Sharma K S
          13.
          Publish Application Priority to TimelineServer Sub-task Resolved Sunil Govindan
          14.
          Render cluster Max Priority in scheduler metrics in RM web UI Sub-task Resolved Rohith Sharma K S
          15.
          Document ApplicationPriority feature Sub-task Resolved Rohith Sharma K S
          16.
          Runtime Application Priority change should not throw exception for applications at finishing states Sub-task Resolved Sunil Govindan
          17.
          Retrospect update ApplicationPriority API return type Sub-task Resolved Rohith Sharma K S
          18.
          AM need to be notified with priority in AllocateResponse Sub-task Resolved Sunil Govindan
          19.
          Retrospect app-priority in pendingOrderingPolicy during recovering applications Sub-task Resolved Rohith Sharma K S
          20.
          Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy Sub-task Resolved Rohith Sharma K S
          21.
          updateApplicationPriority api in scheduler should ensure to re-insert app to correct ordering policy Sub-task Resolved Bibin A Chundatt
          22.
          Retrospect updateApplicationPriority api to handle state store exception in align with YARN-5611 Sub-task Resolved Sunil Govindan

            Activity

              People

              • Assignee:
                sunilg Sunil Govindan
                Reporter:
                acmurthy Arun C Murthy
              • Votes:
                8 Vote for this issue
                Watchers:
                68 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: