[YARN-9017] PlacementRule order is not maintained in CS

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0, 3.3.1
• Component/s: capacity scheduler
• Target Version/s: 3.4.0, 3.3.1
• Hadoop Flags: Reviewed
• Assignee: Bilwa S T
• Reporter: Bibin Chundatt
• Created: 13/Nov/18 16:00
• Updated: 11/Feb/24 12:35
• Resolved: 06/May/20 20:23

Description

yarn.scheduler.queue-placement-rules doesn't work as expected in Capacity Scheduler

• *Queue Mapping Interface based on Default or User Defined Placement Rules* - This feature allows users to map a job to a specific queue based on some default placement rule. For instance based on user & group, or application name. User can also define their own placement rule.

As per current UserGroupMapping is always added in placementRule. CapacityScheduler#updatePlacementRules

    // Initialize placement rules
    Collection<String> placementRuleStrs = conf.getStringCollection(
        YarnConfiguration.QUEUE_PLACEMENT_RULES);
    List<PlacementRule> placementRules = new ArrayList<>();
...

    // add UserGroupMappingPlacementRule if absent
    distingushRuleSet.add(YarnConfiguration.USER_GROUP_PLACEMENT_RULE);

PlacementRule configuration order is not maintained