Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2395

FairScheduler: Preemption timeout should be configurable per queue

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.6.0
    • Component/s: fairscheduler
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently in fair scheduler, the preemption logic considers fair share starvation only at leaf queue level. This jira is created to implement it at the parent queue as well.
      It involves :
      1. Making "check for fair share starvation" and "amount of resource to preempt" recursive such that they traverse the queue hierarchy from root to leaf.
      2. Currently fairSharePreemptionTimeout is a global config. We could make it configurable on a per queue basis,so that we can specify different timeouts for parent queues.

        Attachments

        1. YARN-2395-5.patch
          45 kB
          Wei Yan
        2. YARN-2395-5.patch
          45 kB
          Wei Yan
        3. YARN-2395-5.patch
          45 kB
          Wei Yan
        4. YARN-2395-4.patch
          46 kB
          Wei Yan
        5. YARN-2395-3.patch
          43 kB
          Wei Yan
        6. YARN-2395-3.patch
          43 kB
          Wei Yan
        7. YARN-2395-2.patch
          43 kB
          Wei Yan
        8. YARN-2395-1.patch
          34 kB
          Wei Yan

          Activity

            People

            • Assignee:
              ywskycn Wei Yan
              Reporter:
              ashwinshankar77 Ashwin Shankar
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: