Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8509

Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: yarn
    • Target Version/s:

      Description

      In LeafQueue#getTotalPendingResourcesConsideringUserLimit, we calculate total pending resource based on user-limit percent and user-limit factor which will cap pending resource for each user to the minimum of user-limit pending and actual pending. This will prevent queue from taking more pending resource to achieve queue balance after all queue satisfied with its ideal allocation.
       
      We need to change the logic to let queue pending can go beyond userlimit.

        Attachments

        1. YARN-8509.005.patch
          56 kB
          Zian Chen
        2. YARN-8509.004.patch
          47 kB
          Zian Chen
        3. YARN-8509.003.patch
          27 kB
          Zian Chen
        4. YARN-8509.002.patch
          26 kB
          Zian Chen
        5. YARN-8509.001.patch
          16 kB
          Zian Chen

          Issue Links

            Activity

              People

              • Assignee:
                Zian Chen Zian Chen
                Reporter:
                Zian Chen Zian Chen
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated: