[HADOOP-14207] "dfsadmin -refreshCallQueue" fails with DecayRpcScheduler

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 2.9.0, 3.0.0-alpha4, 2.8.2
• Component/s: rpc-server
• Target Version/s: 2.8.1
• Hadoop Flags: Reviewed
• Assignee: Surendra Singh Lilhore
• Reporter: Surendra Singh Lilhore
• Created: 21/Mar/17 15:09
• Updated: 25/Oct/19 20:25
• Resolved: 04/May/17 23:18

Description

java.lang.RuntimeException: org.apache.hadoop.ipc.DecayRpcScheduler could not be constructed.
        at org.apache.hadoop.ipc.CallQueueManager.createScheduler(CallQueueManager.java:89)
        at org.apache.hadoop.ipc.CallQueueManager.swapQueue(CallQueueManager.java:260)
        at org.apache.hadoop.ipc.Server.refreshCallQueue(Server.java:650)
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.refreshCallQueue(NameNodeRpcServer.java:1582)
        at org.apache.hadoop.ipc.protocolPB.RefreshCallQueueProtocolServerSideTranslatorPB.refreshCallQueue(RefreshCallQueueProtocolServerSideTranslatorPB.java:49)
        at org.apache.hadoop.ipc.proto.RefreshCallQueueProtocolProtos$RefreshCallQueueProtocolService$2.callBlockingMethod(RefreshCallQueueProtocolProtos.java:769)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:447)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:989)
        at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:845)
        at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:788)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1807)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2455)
Caused by: org.apache.hadoop.metrics2.MetricsException: Metrics source DecayRpcSchedulerMetrics2.ipc.65110 already exists!
        at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:144)
        at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:117)

Issue Links

• is blocked by: HADOOP-12916 Allow RPC scheduler/callqueue backoff using response times