Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2156

Raid-aware FSCK

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.23.0
    • 0.23.0
    • contrib/raid
    • None
    • Reviewed

    Description

      Currently, FSCK reports files as corrupt even if they can be fixed using parity blocks. We need a tool that only reports files that are irreparably corrupt (i.e., files for which too many data or parity blocks belonging to the same stripe have been lost or corrupted).

      Attachments

        1. MAPREDUCE-2156.patch
          41 kB
          Patrick Kling
        2. MAPREDUCE-2156.3.patch
          41 kB
          Patrick Kling
        3. MAPREDUCE-2156.2.patch
          40 kB
          Patrick Kling

        Issue Links

          depends upon

          Bug - A problem which impairs or prevents the functions of the product. HDFS-1483 DFSClient.getBlockLocations returns BlockLocations with no indication that the corresponding blocks are corrupt

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-2110 add getArchiveIndex to HarFileSystem

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-2111 make getPathInHar public in HarFileSystem

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-1752 Implement getFileBlockLocations in HarFilesystem

          • Major - Major loss of function.
          • Closed

          Activity

            People

              pkling Patrick Kling
              pkling Patrick Kling
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: