[YARN-9841] Capacity scheduler: add support for combined %user + %primary_group mapping

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.3.0
• Component/s: capacity scheduler
• Hadoop Flags: Reviewed
• Assignee: Manikandan R
• Reporter: Peter Bacsko
• Created: 19/Sep/19 08:09
• Updated: 28/Oct/19 17:14
• Resolved: 18/Oct/19 09:22

Description

Right now in CS, using %primary_group with a parent queue is only possible this way:

u:%user:parentqueue.%primary_group

Looking at https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/placement/UserGroupMappingPlacementRule.java, we cannot do something like:

u:%user:%primary_group.%user

Fair Scheduler supports a nested rule where such a placement/mapping rule is possible. This improvement would reduce this feature gap.

Issue Links

• is depended upon by: YARN-9865 Capacity scheduler: add support for combined %user + %secondary_group mapping
• is depended upon by: YARN-9866 u:user2:%primary_group is not working as expected
• is depended upon by: YARN-9938 Validate Parent Queue for QueueMapping contains dynamic group as parent queue
• is related to: YARN-9840 Capacity scheduler: add support for Secondary Group rule mapping