Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15463

Add a tool to validate FsImage

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.4.0
    • namenode
    • None

    Description

      Due to some snapshot related bugs, a fsimage may become corrupted. Using a corrupted fsimage may further result in data loss.

      In some cases, we found that reference counts are incorrect in some corrupted FsImage. One of the goals of the validation tool is to check reference counts.

      Attachments

        1. HDFS-15463.000.patch
          26 kB
          Shashikant Banerjee
        2. FsImageValidation20200718.patch
          36 kB
          Tsz-wo Sze
        3. FsImageValidation20200717b.patch
          35 kB
          Tsz-wo Sze
        4. FsImageValidation20200715c.patch
          29 kB
          Tsz-wo Sze
        5. FsImageValidation20200715b.patch
          28 kB
          Tsz-wo Sze
        6. FsImageValidation20200715.patch
          28 kB
          Tsz-wo Sze
        7. FsImageValidation20200714.patch
          26 kB
          Tsz-wo Sze
        8. FsImageValidation20200712.patch
          25 kB
          Tsz-wo Sze
        9. FsImageValidation20200709.patch
          16 kB
          Tsz-wo Sze

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            szetszwo Tsz-wo Sze
            szetszwo Tsz-wo Sze
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment