[HADOOP-17417] Reduce UGI overhead in token ops

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Later
• Component/s: common, kms, performance, rpc-server, security
• Assignee: Ahmed Hussein
• Reporter: Ahmed Hussein
• Created: 08/Dec/20 17:46
• Updated: 11/Dec/20 21:39
• Resolved: 11/Dec/20 21:39

Description

DelegationTokenIdentifier has a ugiCache but AbstractDelegationTokenManager calls a static method getRemoteUser() which would bypass the cache.

Performance analysis of the KMS revealed the RPC server layer is creating many and redundant UGI instances.. UGIs are not cheap to instantiate, require synchronization, and waste memory. Reducing instantiations will improve the performance of the ipc readers.

 

 

Issue Links

• requires: HADOOP-17416 Reduce synchronization in the token secret manager
• requires: HDFS-15718 Optimize hdfs token op writeLock