[HDFS-15408] Failed execution caused by SocketTimeoutException

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.1
• Component/s: namenode
• Target Version/s: 3.2.1
• Tags: hdfs
• Flags: Patch
• Assignee: Unassigned
• Reporter: huangkunlun
• Created: 11/Jun/20 11:29
• Updated: 02/Aug/20 17:39
• Resolved: 02/Aug/20 17:39

Description

When I execute command: hdfs fsck /
in the hadoop cluster to check the health of the cluster, It always report an error execution failure like below:

Connecting to namenode via http://hadoop20:50070/fsck?ugi=hdfs&path=%2F
Exception in thread "main" java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
	at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
	at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
	at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:735)
	at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:678)
	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1587)
	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492)
	at org.apache.hadoop.hdfs.tools.DFSck.doWork(DFSck.java:359)
	at org.apache.hadoop.hdfs.tools.DFSck.access$000(DFSck.java:72)
	at org.apache.hadoop.hdfs.tools.DFSck$1.run(DFSck.java:159)
	at org.apache.hadoop.hdfs.tools.DFSck$1.run(DFSck.java:156)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)
	at org.apache.hadoop.hdfs.tools.DFSck.run(DFSck.java:155)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
	at org.apache.hadoop.hdfs.tools.DFSck.main(DFSck.java:402)

We try to solve this problem by adding a new parameter: dfs.fsck.http.timeout.ms to control the connectionTimeout and the readTimeout if the HttpConnection in DFSck.java .Please check is it the right way to solve the problem? thanks a lot!