Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10009

In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.10.0, 3.3.0, 3.2.1, 3.1.3, 2.10.1
    • Fix Version/s: 3.3.0, 3.2.2, 3.1.4, 2.10.1
    • Component/s: capacity scheduler
    • Labels:
      None

      Description

        Memory Vcores res_1
      Queue1 Totals 20GB 100 80
      Resources requested by App1 in Queue1 8GB (40% of total) 8 (8% of total) 80 (100% of total)

      In the previous use case:

      • Queue1 has a value of 25 for miminum-user-limit-percent
      • User1 has requested 8 containers with <memory:1GB, vcores:8, res_1:10> each
      • res_1 will be the dominant resource this case.

      All 8 containers should be assigned by the capacity scheduler, but with min user limit pct set to 25, only 2 containers are assigned.

        Attachments

        1. YARN-10009.UT.patch
          9 kB
          Eric Payne
        2. YARN-10009.branch-2.10.003.patch
          10 kB
          Eric Payne
        3. YARN-10009.004.patch
          10 kB
          Eric Payne
        4. YARN-10009.003.patch
          10 kB
          Eric Payne
        5. YARN-10009.002.patch
          10 kB
          Eric Payne
        6. YARN-10009.001.patch
          10 kB
          Eric Payne

          Activity

            People

            • Assignee:
              epayne Eric Payne
              Reporter:
              epayne Eric Payne
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: