[YARN-10834] Intra-queue preemption: apps that don't use defined custom resource won't be preempted.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0, 2.10.2, 3.2.3, 3.3.2
• Fix Version/s: 3.4.0, 2.10.2, 3.2.3, 3.3.2
• Component/s: scheduler preemption
• Target Version/s: 3.4.0, 2.10.2, 3.2.3, 3.3.2
• Hadoop Flags: Reviewed
• Assignee: Eric Payne
• Reporter: Eric Payne
• Created: 25/Jun/21 20:07
• Updated: 11/Feb/24 09:06
• Resolved: 29/Jun/21 14:26

Description

YARN-8292 added handling of negative resources during the preemption calculation phase. That JIRA hard-coded it so that for inter-(cross-)queue preemption, the a single resource in the vector could go negative while calculating ideal assignments and preemptions. It also hard-coded it so that during intra-(in-)queue preemption calculations, no resource could not go negative. YARN-10613 made these options configurable.

However, in clusters where custom resources are defined, apps that don't use the extended resource won't be preempted.