Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8292

Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.2.0, 3.1.1
    • Component/s: yarn
    • Labels:
      None

      Description

      This is an example of the problem:
       

          //   guaranteed,  max,    used,   pending
          "root(=[30:18:6  30:18:6 12:12:6 1:1:1]);" + //root
              "-a(=[10:6:2 10:6:2  6:6:3   0:0:0]);" + // a
              "-b(=[10:6:2 10:6:2  6:6:3   0:0:0]);" + // b
              "-c(=[10:6:2 10:6:2  0:0:0   1:1:1])"; // c
      

      There're 3 resource types. Total resource of the cluster is 30:18:6
      For both of a/b, there're 3 containers running, each of container is 2:2:1.
      Queue c uses 0 resource, and have 1:1:1 pending resource.

      Under existing logic, preemption cannot happen.

        Attachments

        1. YARN-8292.001.patch
          27 kB
          Wangda Tan
        2. YARN-8292.002.patch
          27 kB
          Wangda Tan
        3. YARN-8292.003.patch
          27 kB
          Wangda Tan
        4. YARN-8292.004.patch
          34 kB
          Wangda Tan
        5. YARN-8292.005.patch
          38 kB
          Wangda Tan
        6. YARN-8292.006.patch
          38 kB
          Wangda Tan
        7. YARN-8292.007.patch
          39 kB
          Wangda Tan
        8. YARN-8292.008.patch
          41 kB
          Wangda Tan
        9. YARN-8292.009.patch
          41 kB
          Wangda Tan

          Issue Links

            Activity

              People

              • Assignee:
                leftnoteasy Wangda Tan
                Reporter:
                ssathish@hortonworks.com Sumana Sathish
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: