Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8031 Follow-on work for erasure coding phase I (striping layout)
  3. HDFS-10975

fsck -list-corruptfileblocks does not report corrupt EC files

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha2
    • Fix Version/s: 3.0.0-alpha2
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Fixed a bug that made fsck -list-corruptfileblocks counts corrupt erasure coded files incorrectly.

      Description

      HDFS-10826 fix fsck for corrupt EC files if no parameters are specified.

      However, if I change the test case added in HDFS-10826 (TestFsck#testFsckCorruptECFile) to run "fsck -list-corruptfileblocks", the same test test failed because fsck reports no corrupt files.

      Interestingly, if I run "fsck -files -blocks -replicaDetails" then the test passed and shows the corrupt file.

      Need to fix the discrepancy.

        Attachments

        1. HDFS-10975.1.patch
          3 kB
          Takanobu Asanuma

          Issue Links

          requires

          Sub-task - The sub-task of the issue HDFS-10827 When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              • Assignee:
                tasanuma Takanobu Asanuma
                Reporter:
                weichiu Wei-Chiu Chuang
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: