Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8031 Follow-on work for erasure coding phase I (striping layout)
  3. HDFS-10975

fsck -list-corruptfileblocks does not report corrupt EC files

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha2
    • 3.0.0-alpha2
    • None
    • None
    • Reviewed
    • Fixed a bug that made fsck -list-corruptfileblocks counts corrupt erasure coded files incorrectly.

    Description

      HDFS-10826 fix fsck for corrupt EC files if no parameters are specified.

      However, if I change the test case added in HDFS-10826 (TestFsck#testFsckCorruptECFile) to run "fsck -list-corruptfileblocks", the same test test failed because fsck reports no corrupt files.

      Interestingly, if I run "fsck -files -blocks -replicaDetails" then the test passed and shows the corrupt file.

      Need to fix the discrepancy.

      Attachments

        1. HDFS-10975.1.patch
          3 kB
          Takanobu Asanuma

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            tasanuma Takanobu Asanuma
            weichiu Wei-Chiu Chuang
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment