[HADOOP-10233] RPC lacks output flow control

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Duplicate
• Affects Version/s: 2.0.0-alpha, 3.0.0-alpha1
• Component/s: ipc
• Assignee: Unassigned
• Reporter: Daryn Sharp
• Created: 14/Jan/14 22:58
• Updated: 12/May/16 18:25
• Resolved: 29/Jan/14 20:12

Description

The RPC layer has input flow control via the callq, however it lacks any output flow control. A handler will try to directly send the response. If the full response is not sent then it is queued for the background responder thread. The RPC layer may end up queuing so many buffers that it "locks" up in GC.

Issue Links

• duplicates: HADOOP-8942 Thundering herd of RPCs with large responses leads to OOM