[HDFS-8845] DiskChecker should not traverse the entire tree

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.8.0, 2.7.3, 2.6.5, 3.0.0-alpha1
• Target Version/s: 2.8.0, 2.6.5
• Assignee: Chang Li
• Reporter: Chang Li
• Created: 31/Jul/15 19:39
• Updated: 25/Oct/19 20:25
• Resolved: 17/Aug/15 22:25

Description

DiskChecker should not traverse entire tree because it's causing heavy disk load on checkDiskError()

Issue Links

• duplicates: HDFS-8564 BlockPoolSlice.checkDirs() will trigger excessive IO while traversing all sub-directories under finalizedDir
• is duplicated by: HDFS-8617 Throttle DiskChecker#checkDirs() speed.
• is related to: HDFS-9923 Datanode disk failure handling is not consistent
• is related to: HDFS-9819 FsVolume should tolerate few times check-dir failed due to deletion by mistake
• relates to: HDFS-8564 BlockPoolSlice.checkDirs() will trigger excessive IO while traversing all sub-directories under finalizedDir