[HDFS-1171] RaidNode should fix missing blocks directly on Data Node

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 0.20.1
• Component/s: contrib/raid
• Assignee: Ramkumar Vadali
• Reporter: Ramkumar Vadali
• Created: 21/May/10 16:51
• Updated: 25/Oct/10 20:43
• Resolved: 25/Oct/10 20:43

Description

RaidNode currently does not fix missing blocks. The missing blocks have to be fixed manually.

This task proposes that recovery be more automated:
1. RaidNode periodically fetches a list of corrupt files from the NameNode
2. If the corrupt files has a RAID parity file, RaidNode identifies missing block(s) in the file and recomputes the block(s) using the parity file and other good blocks
3. RaidNode sends the generated block contents to a DataNode
a. RaidNode chooses a DataNode with the most available space to send the block.