Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
3.4.0
-
None
Description
yarn.scheduler.queue-placement-rules doesn't work as expected in Capacity Scheduler
- *Queue Mapping Interface based on Default or User Defined Placement Rules* - This feature allows users to map a job to a specific queue based on some default placement rule. For instance based on user & group, or application name. User can also define their own placement rule.
As per current UserGroupMapping is always added in placementRule. CapacityScheduler#updatePlacementRules
// Initialize placement rules Collection<String> placementRuleStrs = conf.getStringCollection( YarnConfiguration.QUEUE_PLACEMENT_RULES); List<PlacementRule> placementRules = new ArrayList<>(); ... // add UserGroupMappingPlacementRule if absent distingushRuleSet.add(YarnConfiguration.USER_GROUP_PLACEMENT_RULE);
PlacementRule configuration order is not maintained