Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4917

multiple BlockFixer should be supported in order to improve scalability and reduce too much work on single BlockFixer

    XMLWordPrintableJSON

    Details

      Description

      current implementation can only run single BlockFixer since the fsck (in RaidDFSUtil.getCorruptFiles) only check the whole DFS file system. multiple BlockFixer will do the same thing and try to fix same file if multiple BlockFixer launched.
      the change/fix will be mainly in BlockFixer.java and RaidDFSUtil.getCorruptFile(), to enable fsck to check the different paths defined in separated Raid.xml for single RaidNode/BlockFixer

        Attachments

        1. MAPREDUCE-4917.1.patch
          5 kB
          Jun Jin
        2. MAPREDUCE-4917.2.patch
          5 kB
          parrot18

          Activity

            People

            • Assignee:
              vesslanjin Jun Jin
              Reporter:
              vesslanjin Jun Jin
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 672h
                672h
                Remaining:
                Remaining Estimate - 672h
                672h
                Logged:
                Time Spent - Not Specified
                Not Specified