Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-2280

BackupNode fails with MD5 checksum Exception during checkpoint if BN's image is outdated.

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.22.0
    • Component/s: namenode
    • Labels:
      None

      Description

      If BN starts after NN made changes to namespace it fails with MD5 checksum Exception during checkpoint when it reads new image upload from NN. This is happening because imageDigest is not reset to null, but keeps the value of the originally loaded BN image.

      1. checksumException.patch
        0.9 kB
        Konstantin Shvachko

        Activity

        Hide
        Konstantin Shvachko added a comment -

        In the patch I

        1. set imageDigest to null in BackupStorage.reset() to make sure the old digest is not interfering with newly loaded images.
        2. and populate imageDigest obtained from NN to BN's imageDigest before the new image is loaded on BN in order to ensure it is verified against the expected value.
        Show
        Konstantin Shvachko added a comment - In the patch I set imageDigest to null in BackupStorage.reset() to make sure the old digest is not interfering with newly loaded images. and populate imageDigest obtained from NN to BN's imageDigest before the new image is loaded on BN in order to ensure it is verified against the expected value.
        Hide
        Konstantin Shvachko added a comment -

        tests are passing for 0.22

        Show
        Konstantin Shvachko added a comment - tests are passing for 0.22
        Hide
        Konstantin Shvachko added a comment -

        I just committed this.

        Show
        Konstantin Shvachko added a comment - I just committed this.
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-22-branch #82 (See https://builds.apache.org/job/Hadoop-Hdfs-22-branch/82/)
        HDFS-2280. BackupNode fails with MD5 checksum Exception. Contributed by Konstantin Shvachko.

        shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1165944
        Files :

        • /hadoop/common/branches/branch-0.22/hdfs/CHANGES.txt
        • /hadoop/common/branches/branch-0.22/hdfs/src/java/org/apache/hadoop/hdfs/server/namenode/BackupStorage.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-22-branch #82 (See https://builds.apache.org/job/Hadoop-Hdfs-22-branch/82/ ) HDFS-2280 . BackupNode fails with MD5 checksum Exception. Contributed by Konstantin Shvachko. shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1165944 Files : /hadoop/common/branches/branch-0.22/hdfs/CHANGES.txt /hadoop/common/branches/branch-0.22/hdfs/src/java/org/apache/hadoop/hdfs/server/namenode/BackupStorage.java

          People

          • Assignee:
            Konstantin Shvachko
            Reporter:
            Konstantin Shvachko
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development