Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-1481

NameNode should validate fsimage before rolling

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.23.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      We had an incident that the fsimage at secondary NameNode was truncated but got uploaded to the primary NameNode. The primary NameNode simply rolled the image without checking its integrity, therefore causing the fsimage to corrupt. The primary NameNode should check the new image's integrity before rolling fsimage.

      1. trunkValidateUpload1.patch
        7 kB
        Hairong Kuang
      2. trunkValidateUpload.patch
        7 kB
        Hairong Kuang

        Issue Links

          Activity

          Hairong Kuang made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 0.23.0 [ 12315571 ]
          Fix Version/s 0.22.0 [ 12314241 ]
          Resolution Fixed [ 1 ]
          Hairong Kuang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hadoop Flags [Reviewed]
          Hairong Kuang made changes -
          Attachment trunkValidateUpload1.patch [ 12460147 ]
          Hairong Kuang made changes -
          Attachment trunkValidateUpload.patch [ 12459204 ]
          Hairong Kuang made changes -
          Field Original Value New Value
          Link This issue is blocked by HDFS-903 [ HDFS-903 ]
          Hairong Kuang created issue -

            People

            • Assignee:
              Hairong Kuang
              Reporter:
              Hairong Kuang
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development