[HADOOP-95] dfs validation

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.1.0
• Fix Version/s: 0.2.0
• Assignee: Unassigned
• Reporter: Hairong Kuang
• Created: 18/Mar/06 09:31
• Updated: 08/Jul/09 16:41
• Resolved: 18/Oct/06 18:31

Description

Dfs needs a validation operation similiar to fsck, so that we get to know the files that are corrupted and which data blocks are missing.

Dfs namenode also needs to log more specific information such as which block is replication or is deleted. So when something goes wrong, we have a clue what has happened.

Issue Links

• is related to: HADOOP-500 Datanode should scan blocks continuously to detect bad blocks / CRC errors