Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8495

Priority scheduling support in FairShare scheduler

    XMLWordPrintableJSON

Details

    • Wish
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • fairscheduler
    • None

    Description

       In production environment, priority scheduling is of vital importance to us as we have lots of queues for different departments, then create applications but some of them are not so important as others, so we must guarantee the import ones to supply service.  

      Based on the priority of the application, Fair Scheduler should be able to give preference to application while scheduling.

      Comparator<FairShareComparator> applicationComparator can be changed as below.
      1. Check for Application priority. If priority is available, then return the highest priority job.
      2. Otherwise continue with existing logic such as Fair Share comparison and App ID comparison and then TimeStamp comparison.

      Attachments

        1. YARN-8495.001.patch
          21 kB
          Zhanchun Zhang

        Activity

          People

            Unassigned Unassigned
            Dillon. Zhanchun Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: