[HADOOP-17467] netgroup-user is not added to Groups.cache

• Type: Bug
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.4.0
• Component/s: security
• Labels: pull-request-available
• Assignee: Ahmed Hussein
• Reporter: Ahmed Hussein
• Created: 13/Jan/21 22:38
• Updated: 25/Mar/21 19:02

Description

After the optimization in HADOOP-17079, both JniBasedUnixGroupsNetgroupMapping and ShellBasedUnixGroupsNetgroupMapping do not implement getGroupSet.
As a result, Groups.load() load the cache calling fetchGroupSet which yield to the superclass JniBasedUnixGroupsMapping / ShellBasedUnixGroupsMapping.
In other words, the groups mapping will never fetch from NetgroupCache.

This alters the behavior of the implementation. Is there a reason to bypass loading. CC: xyao

This jira is to add missing implementation getGroupSet to JniBasedUnixGroupsNetgroupMapping and ShellBasedUnixGroupsNetgroupMapping .

Issue Links

• is caused by: HADOOP-17079 Optimize UGI#getGroups by adding UGI#getGroupsSet
• is required by: HADOOP-17481 Groups user mapping based on Netgroup do not auto-refresh
• is required by: HADOOP-17488 Race condition refreshing NetgroupCache
• is required by: HADOOP-17485 port UGI#getGroupsSet optimizations into 2.10
• links to: GitHub Pull Request #2640