Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-596

Use scheduling policies throughout the queue hierarchy to decide which containers to preempt

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.3-alpha
    • 2.5.0
    • scheduler
    • None

    Description

      In the fair scheduler, containers are chosen for preemption in the following way:
      All containers for all apps that are in queues that are over their fair share are put in a list.
      The list is sorted in order of the priority that the container was requested in.

      This means that an application can shield itself from preemption by requesting it's containers at higher priorities, which doesn't really make sense.

      Also, an application that is not over its fair share, but that is in a queue that is over it's fair share is just as likely to have containers preempted as an application that is over its fair share.

      Attachments

        1. YARN-596.patch
          42 kB
          Wei Yan
        2. YARN-596.patch
          41 kB
          Wei Yan
        3. YARN-596.patch
          41 kB
          Wei Yan
        4. YARN-596.patch
          41 kB
          Wei Yan
        5. YARN-596.patch
          40 kB
          Wei Yan
        6. YARN-596.patch
          40 kB
          Wei Yan
        7. YARN-596.patch
          35 kB
          Wei Yan
        8. YARN-596.patch
          34 kB
          Wei Yan
        9. YARN-596.patch
          45 kB
          Wei Yan
        10. YARN-596.patch
          46 kB
          Wei Yan
        11. YARN-596.patch
          45 kB
          Wei Yan
        12. YARN-596.patch
          29 kB
          Wei Yan

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ywskycn Wei Yan
            sandyr Sandy Ryza
            Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment