[YARN-8967] Change FairScheduler to use PlacementRule interface

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.3.0
• Component/s: capacityscheduler, fairscheduler
• Hadoop Flags: Reviewed
• Assignee: Wilfred Spiegelenburg
• Reporter: Wilfred Spiegelenburg
• Created: 02/Nov/18 12:09
• Updated: 26/Feb/20 05:29
• Resolved: 26/Mar/19 05:51

Description

The PlacementRule interface was introduced to be used by all schedulers as per YARN-3635. The CapacityScheduler is using it but the FairScheduler is not and is using its own rule definition.

YARN-8948 cleans up the implementation and removes the CS references which should allow this change to go through.
This would be the first step in using one placement rule engine for both schedulers.

Issue Links

• causes: YARN-9431 Fix flaky junit test fair.TestAppRunnability after YARN-8967
• contains: YARN-5387 FairScheduler: add the ability to specify a parent queue to all placement rules
• contains: YARN-2257 Add user to queue mappings to automatically place users' apps into specific queues
• requires: YARN-8948 PlacementRule interface should be for all YarnSchedulers
• requires: YARN-9298 Implement FS placement rules using PlacementRule interface
• supercedes: YARN-8793 QueuePlacementPolicy bind more information to assigning result