Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4945 [Umbrella] Capacity Scheduler Preemption Within a queue
  3. YARN-2113

Add cross-user preemption within CapacityScheduler's leaf-queue

    XMLWordPrintableJSON

Details

    Description

      Preemption today only works across queues and moves around resources across queues per demand and usage. We should also have user-level preemption within a queue, to balance capacity across users in a predictable manner.

      Attachments

        1. YARN-2113.branch-2.0021.patch
          113 kB
          Eric Payne
        2. YARN-2113.branch-2.0020.patch
          118 kB
          Eric Payne
        3. YARN-2113.branch-2.8.0020.patch
          116 kB
          Eric Payne
        4. YARN-2113.branch-2.0019.patch
          119 kB
          Eric Payne
        5. YARN-2113.branch-2.8.0019.patch
          116 kB
          Eric Payne
        6. YARN-2113.0019.patch
          115 kB
          Sunil G
        7. YARN-2113.0018.patch
          115 kB
          Sunil G
        8. YARN-2113.0017.patch
          110 kB
          Sunil G
        9. YARN-2113.0016.patch
          100 kB
          Sunil G
        10. YARN-2113.0015.patch
          100 kB
          Sunil G
        11. YARN-2113.0014.patch
          100 kB
          Sunil G
        12. YARN-2113 Intra-QueuePreemption Behavior.pdf
          74 kB
          Sunil G
        13. YARN-2113.0013.patch
          98 kB
          Sunil G
        14. YARN-2113.apply.onto.0012.ericp.patch
          8 kB
          Eric Payne
        15. YARN-2113.0012.patch
          92 kB
          Sunil G
        16. YARN-2113.0011.patch
          89 kB
          Sunil G
        17. IntraQueue Preemption-Impact Analysis.pdf
          41 kB
          Sunil G
        18. YARN-2113.0010.patch
          89 kB
          Sunil G
        19. YARN-2113.0009.patch
          89 kB
          Sunil G
        20. YARN-2113.0008.patch
          87 kB
          Sunil G
        21. YARN-2113.0007.patch
          80 kB
          Sunil G
        22. YARN-2113.0006.patch
          77 kB
          Sunil G
        23. YARN-2113.0005.patch
          77 kB
          Sunil G
        24. TestNoIntraQueuePreemptionIfBelowUserLimitAndDifferentPrioritiesWithExtraUsers.txt
          10 kB
          Eric Payne
        25. YARN-2113.0004.patch
          59 kB
          Sunil G
        26. YARN-2113.0003.patch
          65 kB
          Sunil G
        27. YARN-2113.0002.patch
          64 kB
          Sunil G
        28. YARN-2113.0001.patch
          46 kB
          Sunil G
        29. YARN-2113.v0.patch
          25 kB
          Sunil G

        Issue Links

          is related to

          Sub-task - The sub-task of the issue YARN-4108 CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              sunilg Sunil G
              vinodkv Vinod Kumar Vavilapalli
              Votes:
              0 Vote for this issue
              Watchers:
              26 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: