Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-45 [Preemption] Scheduler feedback to AM to release containers
  3. YARN-4108

CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      This is sibling JIRA for YARN-2154. We should make sure container preemption is more effective.

      Requirements::
      1) Can handle case of user-limit preemption
      2) Can handle case of resource placement requirements, such as: hard-locality (I only want to use rack-1) / node-constraints (YARN-3409) / black-list (I don't want to use rack1 and host[1-3])
      3) Can handle preemption within a queue: cross user preemption (YARN-2113), cross applicaiton preemption (such as priority-based (YARN-1963) / fairness-based (YARN-3319)).

        Attachments

        1. YARN-4108-design-doc-V3.pdf
          158 kB
          Wangda Tan
        2. YARN-4108-design-doc-v2.pdf
          206 kB
          Wangda Tan
        3. YARN-4108-design-doc-v1.pdf
          162 kB
          Wangda Tan
        4. YARN-4108.poc.4-WIP.patch
          108 kB
          Wangda Tan
        5. YARN-4108.poc.3-WIP.patch
          68 kB
          Wangda Tan
        6. YARN-4108.poc.2-WIP.patch
          46 kB
          Wangda Tan
        7. YARN-4108.poc.1.patch
          150 kB
          Wangda Tan
        8. YARN-4108.9.patch
          160 kB
          Wangda Tan
        9. YARN-4108.8.patch
          161 kB
          Wangda Tan
        10. YARN-4108.7.patch
          161 kB
          Wangda Tan
        11. YARN-4108.6.patch
          146 kB
          Wangda Tan
        12. YARN-4108.5.patch
          145 kB
          Wangda Tan
        13. YARN-4108.4.patch
          136 kB
          Wangda Tan
        14. YARN-4108.3.patch
          130 kB
          Wangda Tan
        15. YARN-4108.2.patch
          130 kB
          Wangda Tan
        16. YARN-4108.11.patch
          160 kB
          Wangda Tan
        17. YARN-4108.10.patch
          166 kB
          Wangda Tan
        18. YARN-4108.1.patch
          130 kB
          Wangda Tan

          Issue Links

            Activity

              People

              • Assignee:
                leftnoteasy Wangda Tan
                Reporter:
                leftnoteasy Wangda Tan
              • Votes:
                0 Vote for this issue
                Watchers:
                21 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: