[HADOOP-9420] Add percentile or max metric for rpcQueueTime, processing time

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.3-alpha
• Fix Version/s: 2.3.0
• Component/s: ipc, metrics
• Assignee: Liang Xie
• Reporter: Todd Lipcon
• Created: 20/Mar/13 17:10
• Updated: 24/Feb/14 20:56
• Resolved: 09/Jan/14 23:43

Description

Currently, we only export averages for rpcQueueTime and rpcProcessingTime. These metrics are most useful when looking at timeouts and slow responses, which in my experience are often caused by momentary spikes in load, which won't show up in averages over the 15+ second time intervals often used by metrics systems. We should collect at least the max queuetime and processing time over each interval, or the percentiles if it's not too expensive.

Issue Links

• is related to: HADOOP-10305 Add "rpc.metrics.quantile.enable" and "rpc.metrics.percentiles.intervals" to core-default.xml