[YARN-10559] Fair sharing intra-queue preemption support in Capacity Scheduler

• Type: Improvement
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.1.4
• Component/s: capacityscheduler
• Target Version/s: 3.1.4
• Assignee: VADAGA ANANYO RAO
• Reporter: VADAGA ANANYO RAO
• Created: 05/Jan/21 05:53
• Updated: 04/Apr/22 05:32

Description

Usecase:

Due to the way Capacity Scheduler preemption works, If a single user submits a large application to a queue (using 100% of resources), that job will not be preempted by future applications from the same user within the same queue. This implies that the later applications will be forced to wait for completion of the long running application. This prevents multiple long running, large, applications from running concurrently.

Support fair sharing among apps while preempting applications from same queue.

Issue Links

• incorporates: YARN-10591 Allow USERLIMIT_FIRST as only valid configuration when FairOrdering is used