[HADOOP-1200] Datanode should periodically do a disk check

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.12.2
• Fix Version/s: 0.13.0
• Assignee: Hairong Kuang
• Reporter: Hairong Kuang
• Created: 03/Apr/07 18:40
• Updated: 08/Jul/09 16:42
• Resolved: 07/May/07 21:05

Description

HADOOP-1170 removed the disk checking feature. But this is a needed feature for maintaining a large cluster. I agree that checking the disk on every I/O is too costly. A nicer approach is to have a thread that periodically do a disk check. It then automatically decommissions itself when any error occurs.

Issue Links

• is related to: HADOOP-163 If a DFS datanode cannot write onto its file system. it should tell the name node not to assign new blocks to it.
• is related to: HADOOP-1170 Very high CPU usage on data nodes because of FSDataset.checkDataDir() on every connect