Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
-
Reviewed
-
Description
UGI#getGroups has been optimized with HADOOP-13442 by avoiding the List->Set->List conversion. However the returned list is not optimized to contains lookup, especially the user's group membership list is huge (thousands+) . This ticket is opened to add a UGI#getGroupsSet and use Set#contains() instead of List#contains() to speed up large group look up while minimize List->Set conversions in Groups#getGroups() call.
Attachments
Attachments
Issue Links
- breaks
-
HADOOP-17505 public interface GroupMappingServiceProvider needs default impl for getGroupsSet()
-
- Resolved
-
- causes
-
HADOOP-17467 netgroup-user is not added to Groups.cache
-
- In Progress
-
-
YARN-10350 TestUserGroupMappingPlacementRule fails
-
- Resolved
-
- incorporates
-
HADOOP-17487 Replace deprecated getGroups with getGroupsSet
-
- Open
-
- is related to
-
HADOOP-13442 Optimize UGI group lookups
-
- Resolved
-
- relates to
-
HADOOP-17485 port UGI#getGroupsSet optimizations into 2.10
-
- In Progress
-
- links to
1.
|
Port HADOOP-17079, HADOOP-17505 to branch-3.3 |
|
Reopened | Wei-Chiu Chuang |
|