[YARN-4212] FairScheduler: Can't create a DRF queue under a FAIR policy queue

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9.0, 3.0.0-alpha4
• Labels: fairscheduler
• Hadoop Flags: Reviewed
• Assignee: Yufei Gu
• Reporter: Arun Suresh
• Created: 30/Sep/15 08:12
• Updated: 04/Apr/17 16:45
• Resolved: 16/Feb/17 07:56

Description

The Fair Scheduler, while performing a recomputeShares() during an update() call, uses the parent queues policy to distribute shares to its children.

If the parent queues policy is 'fair', it only computes weight for memory and sets the vcores fair share of its children to 0.

Assuming a situation where we have 1 parent queue with policy 'fair' and multiple leaf queues with policy 'drf', Any app submitted to the child queues with vcore requirement > 1 will always be above fairshare, since during the recomputeShare process, the child queues were all assigned 0 for fairshare vcores.

Issue Links

• links to: GitHub Pull Request #181