Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-16286

Debug tool to verify the correctness of erasure coding on file

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      Block data in erasure coded block group may corrupt and the block meta (checksum) is unable to discover the corruption in some cases such as EC reconstruction, related issues are:  HDFS-14768, HDFS-15186, HDFS-15240.

      In addition to HDFS-15759, there needs a tool to check erasure coded file whether any block group has data corruption in case of other conditions rather than EC reconstruction, or the feature HDFS-15759(validation during EC reconstruction) is not open(which is close by default now).

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            cndaimin daimin
            cndaimin daimin
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 6.5h
                6.5h

                Slack

                  Issue deployment