[HDFS-5522] Datanode disk error check may be incorrectly skipped

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.23.9, 2.2.0
• Fix Version/s: 2.5.0
• Target Version/s: 2.5.0
• Hadoop Flags: Reviewed
• Assignee: Rushabh Shah
• Reporter: Kihwal Lee
• Created: 15/Nov/13 22:19
• Updated: 17/Feb/16 10:02
• Resolved: 12/May/14 19:18

Description

After HDFS-4581 and HDFS-4699, checkDiskError() is not called when network errors occur during processing data node requests. This appears to create problems when a disk is having problems, but not failing I/O soon.

If I/O hangs for a long time, network read/write may timeout first and the peer may close the connection. Although the error was caused by a faulty local disk, disk check is not being carried out in this case.

Issue Links

• incorporates: HDFS-5503 Datanode#checkDiskError also should check for ClosedChannelException