Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1481

NameNode should validate fsimage before rolling

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.22.0
    • 0.23.0
    • namenode
    • None
    • Reviewed

    Description

      We had an incident that the fsimage at secondary NameNode was truncated but got uploaded to the primary NameNode. The primary NameNode simply rolled the image without checking its integrity, therefore causing the fsimage to corrupt. The primary NameNode should check the new image's integrity before rolling fsimage.

      Attachments

        1. trunkValidateUpload1.patch
          7 kB
          Hairong Kuang
        2. trunkValidateUpload.patch
          7 kB
          Hairong Kuang

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. HDFS-903 NN should verify images and edit logs on startup

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              hairong Hairong Kuang
              hairong Hairong Kuang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: