[YARN-3515] Support intra-queue non-exclusive container allocation within a LeafQueue

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: api, client, resourcemanager
• Assignee: Wangda Tan
• Reporter: Wangda Tan
• Created: 20/Apr/15 21:42
• Updated: 07/Jan/17 01:52

Description

Related to YARN-2498:

YARN-2498 addressed the problem of non-exclusive container preemption in inter-queue level. When a queue over-satisfied on a given partition, ignore_partition_exclusivity containers will be preempted first.

But it is possible that when a queue is under its guaranteed resource, there's pending resources for a given partition, and resources being used by ignore_partition_exclusivity containers. For example:

• App1/App2 in queue-A, app1 wants 30 partition=x containers and app2 uses 30 partition=x ignore_partition-exclusivity containers. It is possible we need reclaim resource from app2 for partition=x.

Relation between this and YARN-2498 is similar to relation between YARN-2069 and YARN-2113.

Issue Links

• depends upon: YARN-2498 Respect labels in preemption policy of capacity scheduler for inter-queue preemption
• is blocked by: YARN-2498 Respect labels in preemption policy of capacity scheduler for inter-queue preemption