[HBASE-13420] RegionEnvironment.offerExecutionLatency Blocks Threads under Heavy Load

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.98.13, 1.0.2, 1.2.0, 1.1.1, 2.0.0
• Component/s: Coprocessors, metrics, Performance
• Hadoop Flags: Reviewed
• Assignee: Andrew Kyle Purtell
• Reporter: John Leach
• Created: 07/Apr/15 20:43
• Updated: 18/Dec/15 04:45
• Resolved: 30/Apr/15 21:22

Description

The ArrayBlockingQueue blocks threads for 20s during a performance run focusing on creating numerous small scans.

I see a buffer size of (100)

private final BlockingQueue<Long> coprocessorTimeNanos = new ArrayBlockingQueue<Long>(
LATENCY_BUFFER_SIZE);

and then I see a drain coming from
MetricsRegionWrapperImpl with 45 second executor
HRegionMetricsWrapperRunable
RegionCoprocessorHost#getCoprocessorExecutionStatistics()
RegionCoprocessorHost#getExecutionLatenciesNanos()

Am I missing something?

Issue Links

• is superceded by: HBASE-14205 RegionCoprocessorHost System.nanoTime() performance bottleneck