[#HADOOP-3678] Avoid spurious "DataXceiver: java.io.IOException: Connection reset by peer" errors in DataNode log

Hadoop Common

Avoid spurious "DataXceiver: java.io.IOException: Connection reset by peer" errors in DataNode log

Created: 01/Jul/08 08:43 PM Updated: 16/Feb/09 05:00 PM

Return to search

Component/s:

None

Affects Version/s:

0.17.0

Fix Version/s:

0.17.2

Time Tracking:

Not Specified

File Attachments:

File Name	Date Attached	Attached By	Size
HADOOP-3678-branch-17.patch	2008-07-03 10:02 PM	Raghu Angadi	1 kB
HADOOP-3678.patch	2008-07-02 06:53 PM	Raghu Angadi	3 kB
HADOOP-3678.patch	2008-07-02 01:21 AM	Raghu Angadi	3 kB

Issue Links:

Reference

This issue is related to:

~~HADOOP-4862~~ A spurious IOException log on DataNode is not completely removed

Hadoop Flags:	Reviewed
Release Note:	Avoid spurious exceptions logged at DataNode when clients read from DFS.
Resolution Date:	18/Jul/08 12:08 AM

Description

« Hide

When a client reads data using read(), it closes the sockets after it is done. Often it might not read till the end of a block. The datanode on the other side keeps writing data until the client connection is closed or end of the block is reached. If the client does not read till the end of the block, Datanode writes an error message and stack trace to the datanode log. It should not. This is not an error and it just pollutes the log and confuses the user.

All

Comments

Work Log

Change History

Subversion Commits

Sort Order:

Repository	Revision	Date	User	Message
ASF	#673509	Wed Jul 02 21:32:28 UTC 2008	rangadi	~~HADOOP-3678~~. Avoid spurious exceptions logged at DataNode when clients read from DFS. (rangadi)
				Files Changed
				MODIFY /hadoop/core/trunk/CHANGES.txt MODIFY /hadoop/core/trunk/src/hdfs/org/apache/hadoop/dfs/DataNode.java

Repository	Revision	Date	User	Message
ASF	#673764	Thu Jul 03 19:00:25 UTC 2008	rangadi	~~HADOOP-3678~~. Avoid spurious exceptions logged at DataNode when clients read from DFS. (rangadi)
				Files Changed
				MODIFY /hadoop/core/branches/branch-0.18/src/hdfs/org/apache/hadoop/dfs/DataNode.java MODIFY /hadoop/core/branches/branch-0.18/CHANGES.txt

Repository	Revision	Date	User	Message
ASF	#677779	Fri Jul 18 00:05:00 UTC 2008	rangadi	~~HADOOP-3678~~. Avoid spurious exceptions logged at DataNode when clients read from DFS. (rangadi)
				Files Changed
				MODIFY /hadoop/core/branches/branch-0.17/src/java/org/apache/hadoop/dfs/DataNode.java MODIFY /hadoop/core/branches/branch-0.17/CHANGES.txt

Repository	Revision	Date	User	Message
ASF	#677781	Fri Jul 18 00:07:11 UTC 2008	rangadi	move change log for ~~HADOOP-3678~~ from 0.18 to 0.17.2
				Files Changed
				MODIFY /hadoop/core/trunk/CHANGES.txt

Repository	Revision	Date	User	Message
ASF	#677782	Fri Jul 18 00:08:15 UTC 2008	rangadi	move change log for ~~HADOOP-3678~~ from 0.18 to 0.17.2
				Files Changed
				MODIFY /hadoop/core/branches/branch-0.18/CHANGES.txt

Repository	Revision	Date	User	Message
ASF	#738697	Thu Jan 29 01:27:12 UTC 2009	rangadi	~~HADOOP-4862~~. Minor : ~~HADOOP-3678~~ did not remove all the cases of spurious IOExceptions logged by DataNode. (Raghu Angadi)
				Files Changed
				MODIFY /hadoop/core/trunk/CHANGES.txt MODIFY /hadoop/core/trunk/src/hdfs/org/apache/hadoop/hdfs/server/datanode/BlockSender.java

Repository	Revision	Date	User	Message
ASF	#738698	Thu Jan 29 01:28:36 UTC 2009	rangadi	~~HADOOP-4862~~. Minor : ~~HADOOP-3678~~ did not remove all the cases of spurious IOExceptions logged by DataNode. (Raghu Angadi)
				Files Changed
				MODIFY /hadoop/core/branches/branch-0.20/CHANGES.txt MODIFY /hadoop/core/branches/branch-0.20 MODIFY /hadoop/core/branches/branch-0.20/src/hdfs/org/apache/hadoop/hdfs/server/datanode/BlockSender.java

Repository	Revision	Date	User	Message
ASF	#738700	Thu Jan 29 01:29:50 UTC 2009	rangadi	~~HADOOP-4862~~. Minor : ~~HADOOP-3678~~ did not remove all the cases of spurious IOExceptions logged by DataNode. (Raghu Angadi)
				Files Changed
				MODIFY /hadoop/core/branches/branch-0.19/src/hdfs/org/apache/hadoop/hdfs/server/datanode/BlockSender.java MODIFY /hadoop/core/branches/branch-0.19 MODIFY /hadoop/core/branches/branch-0.19/CHANGES.txt