[HDFS-9819] FsVolume should tolerate few times check-dir failed due to deletion by mistake

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 2.7.1
• Assignee: Yiqun Lin
• Reporter: Yiqun Lin
• Created: 17/Feb/16 07:23
• Updated: 09/Mar/16 13:03
• Resolved: 19/Feb/16 05:30

Description

FsVolume should tolerate few times check-dir failed because sometimes we will do a delete dir/file operation by mistake in datanode data-dirs. Then the DataNode#startCheckDiskErrorThread will invoking checkDir method periodicity and find dir not existed, throw exception. The checked volume will be added to failed volume list. The blocks on this volume will be replicated again. But actually, this is not needed to do. We should let volume can be tolerated few times check-dir failed like config dfs.datanode.failed.volumes.tolerated.

Issue Links

• is related to: HDFS-9923 Datanode disk failure handling is not consistent
• relates to: HDFS-8845 DiskChecker should not traverse the entire tree