Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15463

Add a tool to validate FsImage

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.4.0
    • namenode
    • None

    Description

      Due to some snapshot related bugs, a fsimage may become corrupted. Using a corrupted fsimage may further result in data loss.

      In some cases, we found that reference counts are incorrect in some corrupted FsImage. One of the goals of the validation tool is to check reference counts.

      Attachments

        1. FsImageValidation20200718.patch
          36 kB
          Tsz-wo Sze
        2. FsImageValidation20200717b.patch
          35 kB
          Tsz-wo Sze
        3. FsImageValidation20200715c.patch
          29 kB
          Tsz-wo Sze
        4. FsImageValidation20200715b.patch
          28 kB
          Tsz-wo Sze
        5. HDFS-15463.000.patch
          26 kB
          Shashikant Banerjee
        6. FsImageValidation20200715.patch
          28 kB
          Tsz-wo Sze
        7. FsImageValidation20200714.patch
          26 kB
          Tsz-wo Sze
        8. FsImageValidation20200712.patch
          25 kB
          Tsz-wo Sze
        9. FsImageValidation20200709.patch
          16 kB
          Tsz-wo Sze

        Issue Links

          Activity

            People

              szetszwo Tsz-wo Sze
              szetszwo Tsz-wo Sze
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: