[HDFS-13369] FSCK Report broken with RequestHedgingProxyProvider

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.8.3, 3.0.0, 3.1.0
• Fix Version/s: 3.3.5
• Component/s: hdfs
• Labels: pull-request-available
• Assignee: Ranith Sardar
• Reporter: Harshakiran Reddy
• Created: 29/Mar/18 09:56
• Updated: 13/Oct/22 04:52
• Resolved: 13/Oct/22 04:51

Description

Scenario:-

1.Configure the RequestHedgingProxy

2. write some files in file system

3. Take FSCK report for the above files

 

bin> hdfs fsck /file1 -locations -files -blocks
Exception in thread "main" java.lang.ClassCastException: org.apache.hadoop.hdfs.server.namenode.ha.RequestHedgingProxyProvider$RequestHedgingInvocationHandler cannot be cast to org.apache.hadoop.ipc.RpcInvocationHandler
at org.apache.hadoop.ipc.RPC.getConnectionIdForProxy(RPC.java:626)
at org.apache.hadoop.io.retry.RetryInvocationHandler.getConnectionId(RetryInvocationHandler.java:438)
at org.apache.hadoop.ipc.RPC.getConnectionIdForProxy(RPC.java:628)
at org.apache.hadoop.ipc.RPC.getServerAddress(RPC.java:611)
at org.apache.hadoop.hdfs.HAUtil.getAddressOfActive(HAUtil.java:263)
at org.apache.hadoop.hdfs.tools.DFSck.getCurrentNamenodeAddress(DFSck.java:257)
at org.apache.hadoop.hdfs.tools.DFSck.doWork(DFSck.java:319)
at org.apache.hadoop.hdfs.tools.DFSck.access$000(DFSck.java:72)
at org.apache.hadoop.hdfs.tools.DFSck$1.run(DFSck.java:156)
at org.apache.hadoop.hdfs.tools.DFSck$1.run(DFSck.java:153)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1836)
at org.apache.hadoop.hdfs.tools.DFSck.run(DFSck.java:152)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
at org.apache.hadoop.hdfs.tools.DFSck.main(DFSck.java:385)

 

Issue Links

• is related to: HDFS-9836 RequestHedgingInvocationHandler can't be cast to org.apache.hadoop.ipc.RpcInvocationHandler
• links to: GitHub Pull Request #4917