[YARN-8509] Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Component/s: yarn
• Labels: capacityscheduler
• Target Version/s: 3.5.0
• Assignee: Zian Chen
• Reporter: Zian Chen
• Created: 10/Jul/18 00:52
• Updated: 04/Jan/24 08:40

Description

In LeafQueue#getTotalPendingResourcesConsideringUserLimit, we calculate total pending resource based on user-limit percent and user-limit factor which will cap pending resource for each user to the minimum of user-limit pending and actual pending. This will prevent queue from taking more pending resource to achieve queue balance after all queue satisfied with its ideal allocation.
 
We need to change the logic to let queue pending can go beyond userlimit.

Issue Links

• is related to: YARN-3769 Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler