Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4360

multiple BlockFixer should be supported in order to improve scalability and reduce too much work on single BlockFixer

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 0.22.0
    • Fix Version/s: None
    • Component/s: contrib/raid
    • Labels:

      Description

      current implementation can only run single BlockFixer since the fsck (in RaidDFSUtil.getCorruptFiles) only check the whole DFS file system. multiple BlockFixer will do the same thing and try to fix same file if multiple BlockFixer launched.

      the change/fix will be mainly in BlockFixer.java and RaidDFSUtil.getCorruptFile(), to enable fsck to check the different paths defined in separated Raid.xml for single RaidNode/BlockFixer

        Activity

        Hide
        vesslanjin Jun Jin added a comment -

        first version of patch

        Show
        vesslanjin Jun Jin added a comment - first version of patch
        Hide
        hadoopqa Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12563403/HDFS-4360.patch
        against trunk revision .

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3744//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12563403/HDFS-4360.patch against trunk revision . -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3744//console This message is automatically generated.
        Hide
        andrew.wang Andrew Wang added a comment -

        Resolving since HDFS-RAID has been removed from Hadoop.

        Show
        andrew.wang Andrew Wang added a comment - Resolving since HDFS-RAID has been removed from Hadoop.

          People

          • Assignee:
            Unassigned
            Reporter:
            vesslanjin Jun Jin
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development