Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10009

In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 2.10.0, 3.3.0, 3.2.1, 3.1.3, 2.10.1
    • 3.3.0, 3.2.2, 3.1.4, 2.10.1
    • capacity scheduler
    • None

    Description

        Memory Vcores res_1
      Queue1 Totals 20GB 100 80
      Resources requested by App1 in Queue1 8GB (40% of total) 8 (8% of total) 80 (100% of total)

      In the previous use case:

      • Queue1 has a value of 25 for miminum-user-limit-percent
      • User1 has requested 8 containers with <memory:1GB, vcores:8, res_1:10> each
      • res_1 will be the dominant resource this case.

      All 8 containers should be assigned by the capacity scheduler, but with min user limit pct set to 25, only 2 containers are assigned.

      Attachments

        1. YARN-10009.001.patch
          10 kB
          Eric Payne
        2. YARN-10009.002.patch
          10 kB
          Eric Payne
        3. YARN-10009.003.patch
          10 kB
          Eric Payne
        4. YARN-10009.004.patch
          10 kB
          Eric Payne
        5. YARN-10009.branch-2.10.003.patch
          10 kB
          Eric Payne
        6. YARN-10009.UT.patch
          9 kB
          Eric Payne

        Activity

          People

            epayne Eric Payne
            epayne Eric Payne
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: