[SENTRY-1871] Improve performance of ACL lookups for the Sentry Name Node plugin

• Type: Improvement
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.8.0
• Component/s: Hdfs Plugin
• Assignee: Brian Towles
• Reporter: Brian Towles
• Created: 02/Aug/17 13:38
• Updated: 13/Sep/18 16:49

Description

The performance of acl lookups for the HDFS is slow for very large numbers of paths because the paths are stored as a tree on the NN plugin side. When a lookup on an ACL occurs (getACLFeature call) it is a O(log n) operation for each one. This can be changed to a Hash lookup based on path of only paths with authorization objects attached to them. This would change it to a O(1) lookup per path.