Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8509

Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • yarn

    Description

      In LeafQueue#getTotalPendingResourcesConsideringUserLimit, we calculate total pending resource based on user-limit percent and user-limit factor which will cap pending resource for each user to the minimum of user-limit pending and actual pending. This will prevent queue from taking more pending resource to achieve queue balance after all queue satisfied with its ideal allocation.
       
      We need to change the logic to let queue pending can go beyond userlimit.

      Attachments

        1. YARN-8509.001.patch
          16 kB
          Zian Chen
        2. YARN-8509.002.patch
          26 kB
          Zian Chen
        3. YARN-8509.003.patch
          27 kB
          Zian Chen
        4. YARN-8509.004.patch
          47 kB
          Zian Chen
        5. YARN-8509.005.patch
          56 kB
          Zian Chen

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Zian Chen Zian Chen
            Zian Chen Zian Chen

            Dates

              Created:
              Updated:

              Slack

                Issue deployment