[HADOOP-10172] Cache SASL server factories

• Type: Improvement
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.23.0, 2.0.0-alpha, 3.0.0-alpha1
• Fix Version/s: 2.3.0
• Component/s: ipc
• Hadoop Flags: Reviewed
• Assignee: Daryn Sharp
• Reporter: Daryn Sharp
• Created: 17/Dec/13 18:51
• Updated: 05/Feb/19 12:40
• Resolved: 19/Dec/13 18:28

Description

Performance for SASL server creation is atrocious. Sasl.createSaslServer does not cache the provider resolution for the factories. Factory resolution and server instantiation has 3 major contention points. During bursts of connections, one reader accepting a connection stalls other readers accepting connections, in turn stalling all existing connections handled by those readers.

I benched 5 threads at 187 instances/s - total, not per thread. With this and another change, I've boosted it to 33K instances/s.

Issue Links

• is related to: HADOOP-10173 Remove UGI from DIGEST-MD5 SASL server creation
• relates to: HADOOP-16059 Use SASL Factories Cache to Improve Performance