[HDFS-4532] RPC call queue may fill due to current user lookup

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.23.0, 2.0.0-alpha, 3.0.0-alpha1
• Fix Version/s: 0.23.7, 2.1.0-beta
• Component/s: namenode
• Target Version/s: 2.0.0-alpha
• Hadoop Flags: Reviewed
• Assignee: Daryn Sharp
• Reporter: Daryn Sharp
• Created: 26/Feb/13 20:18
• Updated: 12/May/16 18:12
• Resolved: 04/Mar/13 18:51

Description

Audit logging need to invoke UGI.getCurrentUser to log the user performing an operation. This is a synch'ed method, so audit logging is effectively serializing the completion of concurrent read ops. Under very heavy load, RPC throughput drops dramatically, the call queue fills with thousands of waiting operations, and clients begin timing out. Jstack shows all but one call handler blocked on UGI.getCurrentUser.

Issue Links

• depends upon: HADOOP-9336 Allow UGI of current connection to be queried