Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2395

FairScheduler: Preemption timeout should be configurable per queue

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.6.0
    • fairscheduler
    • None
    • Reviewed

    Description

      Currently in fair scheduler, the preemption logic considers fair share starvation only at leaf queue level. This jira is created to implement it at the parent queue as well.
      It involves :
      1. Making "check for fair share starvation" and "amount of resource to preempt" recursive such that they traverse the queue hierarchy from root to leaf.
      2. Currently fairSharePreemptionTimeout is a global config. We could make it configurable on a per queue basis,so that we can specify different timeouts for parent queues.

      Attachments

        1. YARN-2395-1.patch
          34 kB
          Wei Yan
        2. YARN-2395-2.patch
          43 kB
          Wei Yan
        3. YARN-2395-3.patch
          43 kB
          Wei Yan
        4. YARN-2395-3.patch
          43 kB
          Wei Yan
        5. YARN-2395-4.patch
          46 kB
          Wei Yan
        6. YARN-2395-5.patch
          45 kB
          Wei Yan
        7. YARN-2395-5.patch
          45 kB
          Wei Yan
        8. YARN-2395-5.patch
          45 kB
          Wei Yan

        Activity

          People

            ywskycn Wei Yan
            ashwinshankar77 Ashwin Shankar
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: