Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-45 [Preemption] Scheduler feedback to AM to release containers
  3. YARN-2069

CS queue level preemption should respect user-limits

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • capacityscheduler

    Description

      This is different from (even if related to, and likely share code with) YARN-2113.

      YARN-2113 focuses on making sure that even if queue has its guaranteed capacity, it's individual users are treated in-line with their limits irrespective of when they join in.

      This JIRA is about respecting user-limits while preempting containers to balance queue capacities.

      Attachments

        1. YARN-2069-trunk-1.patch
          26 kB
          Mayank Bansal
        2. YARN-2069-trunk-2.patch
          28 kB
          Mayank Bansal
        3. YARN-2069-trunk-3.patch
          13 kB
          Mayank Bansal
        4. YARN-2069-trunk-4.patch
          15 kB
          Mayank Bansal
        5. YARN-2069-trunk-5.patch
          15 kB
          Mayank Bansal
        6. YARN-2069-trunk-6.patch
          17 kB
          Mayank Bansal
        7. YARN-2069-trunk-7.patch
          28 kB
          Mayank Bansal
        8. YARN-2069-trunk-8.patch
          35 kB
          Mayank Bansal
        9. YARN-2069-trunk-9.patch
          37 kB
          Mayank Bansal
        10. YARN-2069-trunk-10.patch
          38 kB
          Mayank Bansal
        11. YARN-2069-2.6-11.patch
          37 kB
          Mayank Bansal

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue YARN-2022 Preempting an Application Master container can be kept as least priority when multiple applications are marked for preemption by ProportionalCapacityPreemptionPolicy

          • Major - Major loss of function.
          • Closed
          is related to

          Sub-task - The sub-task of the issue YARN-4108 CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              mayank_bansal Mayank Bansal
              vinodkv Vinod Kumar Vavilapalli
              Votes:
              0 Vote for this issue
              Watchers:
              19 Start watching this issue

              Dates

                Created:
                Updated: