Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4945 [Umbrella] Capacity Scheduler Preemption Within a queue
  3. YARN-2113

Add cross-user preemption within CapacityScheduler's leaf-queue

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      Preemption today only works across queues and moves around resources across queues per demand and usage. We should also have user-level preemption within a queue, to balance capacity across users in a predictable manner.

      Attachments

        1. YARN-2113 Intra-QueuePreemption Behavior.pdf
          74 kB
          Sunil G
        2. YARN-2113.v0.patch
          25 kB
          Sunil G
        3. YARN-2113.branch-2.8.0020.patch
          116 kB
          Eric Payne
        4. YARN-2113.branch-2.8.0019.patch
          116 kB
          Eric Payne
        5. YARN-2113.branch-2.0021.patch
          113 kB
          Eric Payne
        6. YARN-2113.branch-2.0020.patch
          118 kB
          Eric Payne
        7. YARN-2113.branch-2.0019.patch
          119 kB
          Eric Payne
        8. YARN-2113.apply.onto.0012.ericp.patch
          8 kB
          Eric Payne
        9. YARN-2113.0019.patch
          115 kB
          Sunil G
        10. YARN-2113.0018.patch
          115 kB
          Sunil G
        11. YARN-2113.0017.patch
          110 kB
          Sunil G
        12. YARN-2113.0016.patch
          100 kB
          Sunil G
        13. YARN-2113.0015.patch
          100 kB
          Sunil G
        14. YARN-2113.0014.patch
          100 kB
          Sunil G
        15. YARN-2113.0013.patch
          98 kB
          Sunil G
        16. YARN-2113.0012.patch
          92 kB
          Sunil G
        17. YARN-2113.0011.patch
          89 kB
          Sunil G
        18. YARN-2113.0010.patch
          89 kB
          Sunil G
        19. YARN-2113.0009.patch
          89 kB
          Sunil G
        20. YARN-2113.0008.patch
          87 kB
          Sunil G
        21. YARN-2113.0007.patch
          80 kB
          Sunil G
        22. YARN-2113.0006.patch
          77 kB
          Sunil G
        23. YARN-2113.0005.patch
          77 kB
          Sunil G
        24. YARN-2113.0004.patch
          59 kB
          Sunil G
        25. YARN-2113.0003.patch
          65 kB
          Sunil G
        26. YARN-2113.0002.patch
          64 kB
          Sunil G
        27. YARN-2113.0001.patch
          46 kB
          Sunil G
        28. TestNoIntraQueuePreemptionIfBelowUserLimitAndDifferentPrioritiesWithExtraUsers.txt
          10 kB
          Eric Payne
        29. IntraQueue Preemption-Impact Analysis.pdf
          41 kB
          Sunil G

        Issue Links

        is related to

        Sub-task - The sub-task of the issue YARN-4108 CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sunilg Sunil G
            vinodkv Vinod Kumar Vavilapalli
            Votes:
            0 Vote for this issue
            Watchers:
            26 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment