[HBASE-12399] Master startup race between metrics and RpcServer

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.98.8, 0.99.2
• Component/s: master
• Hadoop Flags: Reviewed
• Assignee: Nick Dimiduk
• Reporter: Nick Dimiduk
• Created: 31/Oct/14 21:17
• Updated: 06/Apr/18 17:55
• Resolved: 01/Nov/14 17:50

Description

Seeing this on CM tests with frequent master thrashing

2014-10-31 12:01:59,196 ERROR [Timer for 'HBase' metrics system] impl.MetricsSourceAdapter: Error getting metrics from source IPC,sub=IPC
java.lang.NullPointerException
	at org.apache.hadoop.hbase.ipc.FifoRpcScheduler.getGeneralQueueLength(FifoRpcScheduler.java:81)
	at org.apache.hadoop.hbase.ipc.MetricsHBaseServerWrapperImpl.getGeneralQueueLength(MetricsHBaseServerWrapperImpl.java:43)
	at org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceImpl.getMetrics(MetricsHBaseServerSourceImpl.java:117)
	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:195)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.snapshotMetrics(MetricsSystemImpl.java:419)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.sampleMetrics(MetricsSystemImpl.java:406)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.onTimerEvent(MetricsSystemImpl.java:382)
	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl$4.run(MetricsSystemImpl.java:369)
	at java.util.TimerThread.mainLoop(Timer.java:555)
	at java.util.TimerThread.run(Timer.java:505)