Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-596

Use scheduling policies throughout the queue hierarchy to decide which containers to preempt

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.3-alpha
    • Fix Version/s: 2.5.0
    • Component/s: scheduler
    • Labels:
      None

      Description

      In the fair scheduler, containers are chosen for preemption in the following way:
      All containers for all apps that are in queues that are over their fair share are put in a list.
      The list is sorted in order of the priority that the container was requested in.

      This means that an application can shield itself from preemption by requesting it's containers at higher priorities, which doesn't really make sense.

      Also, an application that is not over its fair share, but that is in a queue that is over it's fair share is just as likely to have containers preempted as an application that is over its fair share.

        Attachments

        1. YARN-596.patch
          42 kB
          Wei Yan
        2. YARN-596.patch
          41 kB
          Wei Yan
        3. YARN-596.patch
          41 kB
          Wei Yan
        4. YARN-596.patch
          41 kB
          Wei Yan
        5. YARN-596.patch
          40 kB
          Wei Yan
        6. YARN-596.patch
          40 kB
          Wei Yan
        7. YARN-596.patch
          35 kB
          Wei Yan
        8. YARN-596.patch
          34 kB
          Wei Yan
        9. YARN-596.patch
          45 kB
          Wei Yan
        10. YARN-596.patch
          46 kB
          Wei Yan
        11. YARN-596.patch
          45 kB
          Wei Yan
        12. YARN-596.patch
          29 kB
          Wei Yan

          Activity

            People

            • Assignee:
              ywskycn Wei Yan
              Reporter:
              sandyr Sandy Ryza
            • Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: