Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8031 Follow-on work for erasure coding phase I (striping layout)
  3. HDFS-10975

fsck -list-corruptfileblocks does not report corrupt EC files

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha2
    • Fix Version/s: 3.0.0-alpha2
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Fixed a bug that made fsck -list-corruptfileblocks counts corrupt erasure coded files incorrectly.

      Description

      HDFS-10826 fix fsck for corrupt EC files if no parameters are specified.

      However, if I change the test case added in HDFS-10826 (TestFsck#testFsckCorruptECFile) to run "fsck -list-corruptfileblocks", the same test test failed because fsck reports no corrupt files.

      Interestingly, if I run "fsck -files -blocks -replicaDetails" then the test passed and shows the corrupt file.

      Need to fix the discrepancy.

        Attachments

        1. HDFS-10975.1.patch
          3 kB
          Takanobu Asanuma

        Issue Links

        requires

        Sub-task - The sub-task of the issue HDFS-10827 When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

        • Major - Major loss of function.
        • Resolved

          Activity
          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

            • Assignee:
              tasanuma Takanobu Asanuma
              Reporter:
              weichiu Wei-Chiu Chuang

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment