[HADOOP-12903] IPC Server should allow suppressing exception logging by type, not log 'server too busy' messages

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.2
• Fix Version/s: 2.8.0, 3.0.0-alpha1
• Component/s: ipc
• Hadoop Flags: Reviewed
• Assignee: Arpit Agarwal
• Reporter: Arpit Agarwal
• Created: 07/Mar/16 23:09
• Updated: 30/Aug/16 01:17
• Resolved: 09/Mar/16 07:35

Description

HADOOP-10597 added support for RPC congestion control by sending retriable 'server too busy' exceptions to clients.

However every backoff results in a log message. We've seen these log messages slow down the NameNode.

2016-03-07 15:02:23,272 INFO org.apache.hadoop.ipc.Server: Socket Reader #1 for port 8020: readAndProcess from client 127.0.0.1 threw exception [org.apache.hadoop.ipc.RetriableException: Server is too busy.]

We already have a metric that tracks the number of backoff events. This log message adds nothing useful.

The IPC Server should also allow services to skip logging certain exception types altogether.