Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8292

Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 3.2.0, 3.1.1, 2.10.1
    • yarn
    • None

    Description

      This is an example of the problem:
       

          //   guaranteed,  max,    used,   pending
          "root(=[30:18:6  30:18:6 12:12:6 1:1:1]);" + //root
              "-a(=[10:6:2 10:6:2  6:6:3   0:0:0]);" + // a
              "-b(=[10:6:2 10:6:2  6:6:3   0:0:0]);" + // b
              "-c(=[10:6:2 10:6:2  0:0:0   1:1:1])"; // c
      

      There're 3 resource types. Total resource of the cluster is 30:18:6
      For both of a/b, there're 3 containers running, each of container is 2:2:1.
      Queue c uses 0 resource, and have 1:1:1 pending resource.

      Under existing logic, preemption cannot happen.

      Attachments

        1. YARN-8292.001.patch
          27 kB
          Wangda Tan
        2. YARN-8292.002.patch
          27 kB
          Wangda Tan
        3. YARN-8292.003.patch
          27 kB
          Wangda Tan
        4. YARN-8292.004.patch
          34 kB
          Wangda Tan
        5. YARN-8292.005.patch
          38 kB
          Wangda Tan
        6. YARN-8292.006.patch
          38 kB
          Wangda Tan
        7. YARN-8292.007.patch
          39 kB
          Wangda Tan
        8. YARN-8292.008.patch
          41 kB
          Wangda Tan
        9. YARN-8292.009.patch
          41 kB
          Wangda Tan
        10. YARN-8292.branch-2.009.patch
          37 kB
          Eric Payne
        11. YARN-8292.branch-2.010.patch
          37 kB
          Eric Payne
        12. YARN-8292.branch-2.10.011.patch
          38 kB
          Eric Payne

        Issue Links

          Activity

            People

              leftnoteasy Wangda Tan
              ssathish@hortonworks.com Sumana Sathish
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: