[HDFS-4360] multiple BlockFixer should be supported in order to improve scalability and reduce too much work on single BlockFixer

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.22.0
• Component/s: contrib/raid
• Labels: patch
• Target Version/s: 0.22.0
• Assignee: Unassigned
• Reporter: Jun Jin
• Created: 04/Jan/13 06:09
• Updated: 11/Oct/16 22:37
• Resolved: 11/Oct/16 22:37

Description

current implementation can only run single BlockFixer since the fsck (in RaidDFSUtil.getCorruptFiles) only check the whole DFS file system. multiple BlockFixer will do the same thing and try to fix same file if multiple BlockFixer launched.

the change/fix will be mainly in BlockFixer.java and RaidDFSUtil.getCorruptFile(), to enable fsck to check the different paths defined in separated Raid.xml for single RaidNode/BlockFixer