Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3519

Checkpoint upload may interfere with a concurrent saveNamespace

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • None
    • 2.7.0
    • namenode
    • None
    • Reviewed

    Description

      TestStandbyCheckpoints failed in precommit build 2620 due to the following issue:

      • both nodes were in Standby state, and configured to checkpoint "as fast as possible"
      • NN1 starts to save its own namespace
      • NN2 starts to upload a checkpoint for the same txid. So, both threads are writing to the same file fsimage.ckpt_12, but the actual file contents correspond to the uploading thread's data.
      • NN1 finished its saveNamespace operation while NN2 was still uploading. So, it renamed the ckpt file. However, the contents of the file are still empty since NN2 hasn't sent any bytes
      • NN2 finishes the upload, and the rename() call fails, which causes the directory to be marked failed, etc.

      The result is that there is a file fsimage_12 which appears to be a finalized image but in fact is incompletely transferred. When the transfer completes, the problem "heals itself" so there wouldn't be persistent corruption unless the machine crashes at the same time. And even then, we'd still have the earlier checkpoint to restore from.

      This same race could occur in a non-HA setup if a user puts the NN in safe mode and issues saveNamespace operations concurrent with a 2NN checkpointing, I believe.

      Attachments

        1. test-output.txt
          144 kB
          Todd Lipcon
        2. HDFS-3519.patch
          6 kB
          Ming Ma
        3. HDFS-3519-2.patch
          6 kB
          Ming Ma
        4. HDFS-3519-3.patch
          7 kB
          Ming Ma
        5. HDFS-3519-branch-2.patch
          7 kB
          Ming Ma

        Issue Links

          Activity

            tlipcon Todd Lipcon added a comment -

            Here's the test output from the above-referenced Jenkins build.

            tlipcon Todd Lipcon added a comment - Here's the test output from the above-referenced Jenkins build.
            mingma Ming Ma added a comment -

            To follow up on this, https://issues.apache.org/jira/browse/HDFS-4811 discussed about adding timestamp to checkpoint file name to manage the concurrency. Alternatively, we can move ImageServlet's code that handle s duplicated download requests to FSImage so that it covers regular checkpoint. Any thoughts on this?

            In addition, currentlyDownloadingCheckpoints is declared as static. That is problematic in unit test where two namenodes share the same list. It doesn't need to be static as ImageServlet gets the global FSImage object from NameNodeHttpServer.

            Another thing about the test case, it is possible that the first standby nn checked by the test code finishes the checkpoint and upload before the second standby nn kicks off its checkpoint process; it doesn't appears to be the intention of the test case. We can increase SlowCodec sleep interval for that.

            Chris, sorry didn't checkout the jira owner until after I write up the patch.

            mingma Ming Ma added a comment - To follow up on this, https://issues.apache.org/jira/browse/HDFS-4811 discussed about adding timestamp to checkpoint file name to manage the concurrency. Alternatively, we can move ImageServlet 's code that handle s duplicated download requests to FSImage so that it covers regular checkpoint. Any thoughts on this? In addition, currentlyDownloadingCheckpoints is declared as static. That is problematic in unit test where two namenodes share the same list. It doesn't need to be static as ImageServlet gets the global FSImage object from NameNodeHttpServer . Another thing about the test case, it is possible that the first standby nn checked by the test code finishes the checkpoint and upload before the second standby nn kicks off its checkpoint process; it doesn't appears to be the intention of the test case. We can increase SlowCodec sleep interval for that. Chris, sorry didn't checkout the jira owner until after I write up the patch.
            cnauroth Chris Nauroth added a comment -

            mingma, I'm not actively working on this, so thank you for posting a patch. I have reassigned it to you.

            cnauroth Chris Nauroth added a comment - mingma , I'm not actively working on this, so thank you for posting a patch. I have reassigned it to you.
            hadoopqa Hadoop QA added a comment -

            -1 overall. Here are the results of testing the latest attachment
            http://issues.apache.org/jira/secure/attachment/12691390/HDFS-3519.patch
            against trunk revision ae91b13.

            +1 @author. The patch does not contain any @author tags.

            +1 tests included. The patch appears to include 1 new or modified test files.

            +1 javac. The applied patch does not increase the total number of javac compiler warnings.

            +1 javadoc. There were no new javadoc warning messages.

            +1 eclipse:eclipse. The patch built with eclipse:eclipse.

            +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

            +1 release audit. The applied patch does not increase the total number of release audit warnings.

            -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs:

            org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints

            Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9170//testReport/
            Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9170//console

            This message is automatically generated.

            hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12691390/HDFS-3519.patch against trunk revision ae91b13. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9170//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9170//console This message is automatically generated.
            mingma Ming Ma added a comment -

            The change of slowness parameter from 2 to 20 causes test case testReadsAllowedDuringCheckpoint to time out due to the large number of edits used in that test case. The motivation of adjusting this parameter is to make sure both NNs are doing checkpointing in test case testBothNodesInStandbyState. That doesn't seem be an issue in trunk given OIV image checkpoint adds extra delay before the image upload. Still, we can adjust the value from 2 to 5, just to be safe.

            mingma Ming Ma added a comment - The change of slowness parameter from 2 to 20 causes test case testReadsAllowedDuringCheckpoint to time out due to the large number of edits used in that test case. The motivation of adjusting this parameter is to make sure both NNs are doing checkpointing in test case testBothNodesInStandbyState. That doesn't seem be an issue in trunk given OIV image checkpoint adds extra delay before the image upload. Still, we can adjust the value from 2 to 5, just to be safe.
            hadoopqa Hadoop QA added a comment -

            -1 overall. Here are the results of testing the latest attachment
            http://issues.apache.org/jira/secure/attachment/12691715/HDFS-3519-2.patch
            against trunk revision b78b4a1.

            +1 @author. The patch does not contain any @author tags.

            +1 tests included. The patch appears to include 1 new or modified test files.

            +1 javac. The applied patch does not increase the total number of javac compiler warnings.

            +1 javadoc. There were no new javadoc warning messages.

            +1 eclipse:eclipse. The patch built with eclipse:eclipse.

            +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

            +1 release audit. The applied patch does not increase the total number of release audit warnings.

            -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs:

            org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManager
            org.apache.hadoop.hdfs.server.balancer.TestBalancer
            org.apache.hadoop.hdfs.TestReplaceDatanodeOnFailure

            Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9187//testReport/
            Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9187//console

            This message is automatically generated.

            hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12691715/HDFS-3519-2.patch against trunk revision b78b4a1. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.qjournal.client.TestQuorumJournalManager org.apache.hadoop.hdfs.server.balancer.TestBalancer org.apache.hadoop.hdfs.TestReplaceDatanodeOnFailure Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9187//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9187//console This message is automatically generated.
            cnauroth Chris Nauroth added a comment -

            mingma, thank you for working on this.

            I think the test failures shown in the last Jenkins run are unrelated. I did multiple test runs locally, and they always passed.

            A few comments on the patch:

            • FSImage#saveNamespace: It's possible to leave this method after adding the transaction ID to the checkpointing set, but without removing it. This would leave the transaction ID in the set permanently, and I believe it would then be impossible to checkpoint at that transaction ID again. Even though removeFromCheckpointing is called in a finally block, it is preceded by a call to FSEditLog#startLogSegmentAndWriteHeaderTxn, which can throw IOException. I think we'll need to wrap the whole logic in a second layer of try-finally to guarantee the transaction ID gets removed from the set.
            • FSImage#saveFSImageInAllDirs: Now that this is wrapped in try-finally, there is an existing line of code that needs to be indented.
            cnauroth Chris Nauroth added a comment - mingma , thank you for working on this. I think the test failures shown in the last Jenkins run are unrelated. I did multiple test runs locally, and they always passed. A few comments on the patch: FSImage#saveNamespace : It's possible to leave this method after adding the transaction ID to the checkpointing set, but without removing it. This would leave the transaction ID in the set permanently, and I believe it would then be impossible to checkpoint at that transaction ID again. Even though removeFromCheckpointing is called in a finally block, it is preceded by a call to FSEditLog#startLogSegmentAndWriteHeaderTxn , which can throw IOException . I think we'll need to wrap the whole logic in a second layer of try-finally to guarantee the transaction ID gets removed from the set. FSImage#saveFSImageInAllDirs : Now that this is wrapped in try-finally, there is an existing line of code that needs to be indented.
            mingma Ming Ma added a comment -

            Thanks, Chris. Good point. Here is the updated patch with your suggestions.

            mingma Ming Ma added a comment - Thanks, Chris. Good point. Here is the updated patch with your suggestions.
            hadoopqa Hadoop QA added a comment -

            +1 overall. Here are the results of testing the latest attachment
            http://issues.apache.org/jira/secure/attachment/12693430/HDFS-3519-3.patch
            against trunk revision f250ad1.

            +1 @author. The patch does not contain any @author tags.

            +1 tests included. The patch appears to include 1 new or modified test files.

            +1 javac. The applied patch does not increase the total number of javac compiler warnings.

            +1 javadoc. There were no new javadoc warning messages.

            +1 eclipse:eclipse. The patch built with eclipse:eclipse.

            +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

            +1 release audit. The applied patch does not increase the total number of release audit warnings.

            +1 core tests. The patch passed unit tests in hadoop-hdfs-project/hadoop-hdfs.

            Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9284//testReport/
            Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9284//console

            This message is automatically generated.

            hadoopqa Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12693430/HDFS-3519-3.patch against trunk revision f250ad1. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-hdfs-project/hadoop-hdfs. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9284//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9284//console This message is automatically generated.
            cnauroth Chris Nauroth added a comment -

            +1 for the patch. Ming, thank you for incorporating the feedback. Could you also please provide a branch-2 patch? There is a small difference in FSImage on branch-2 that prevents me from applying the trunk patch.

            cnauroth Chris Nauroth added a comment - +1 for the patch. Ming, thank you for incorporating the feedback. Could you also please provide a branch-2 patch? There is a small difference in FSImage on branch-2 that prevents me from applying the trunk patch.
            mingma Ming Ma added a comment -

            Thanks, Chris. Here is the patch for branch-2.

            mingma Ming Ma added a comment - Thanks, Chris. Here is the patch for branch-2.
            hadoopqa Hadoop QA added a comment -

            -1 overall. Here are the results of testing the latest attachment
            http://issues.apache.org/jira/secure/attachment/12693783/HDFS-3519-branch-2.patch
            against trunk revision ee7d22e.

            -1 patch. The patch command could not apply the patch.

            Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9300//console

            This message is automatically generated.

            hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12693783/HDFS-3519-branch-2.patch against trunk revision ee7d22e. -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9300//console This message is automatically generated.
            cnauroth Chris Nauroth added a comment -

            +1 for the branch-2 patch also. I have committed to both trunk and branch-2. Ming, thank you for contributing this patch.

            cnauroth Chris Nauroth added a comment - +1 for the branch-2 patch also. I have committed to both trunk and branch-2. Ming, thank you for contributing this patch.
            mingma Ming Ma added a comment -

            Thanks, Chris.

            mingma Ming Ma added a comment - Thanks, Chris.
            hudson Hudson added a comment -

            FAILURE: Integrated in Hadoop-trunk-Commit #6915 (See https://builds.apache.org/job/Hadoop-trunk-Commit/6915/)
            HDFS-3519. Checkpoint upload may interfere with a concurrent saveNamespace. Contributed by Ming Ma. (cnauroth: rev d3268c4b10a0f728b554ddb6d69b666a9ca13f12)

            • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java
            • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ImageServlet.java
            • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
            • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestStandbyCheckpoints.java
            hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #6915 (See https://builds.apache.org/job/Hadoop-trunk-Commit/6915/ ) HDFS-3519 . Checkpoint upload may interfere with a concurrent saveNamespace. Contributed by Ming Ma. (cnauroth: rev d3268c4b10a0f728b554ddb6d69b666a9ca13f12) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ImageServlet.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestStandbyCheckpoints.java
            hudson Hudson added a comment -

            FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #82 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/82/)
            HDFS-3519. Checkpoint upload may interfere with a concurrent saveNamespace. Contributed by Ming Ma. (cnauroth: rev d3268c4b10a0f728b554ddb6d69b666a9ca13f12)

            • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
            • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java
            • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ImageServlet.java
            • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestStandbyCheckpoints.java
            hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #82 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/82/ ) HDFS-3519 . Checkpoint upload may interfere with a concurrent saveNamespace. Contributed by Ming Ma. (cnauroth: rev d3268c4b10a0f728b554ddb6d69b666a9ca13f12) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ImageServlet.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestStandbyCheckpoints.java
            hudson Hudson added a comment -

            FAILURE: Integrated in Hadoop-Yarn-trunk #816 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/816/)
            HDFS-3519. Checkpoint upload may interfere with a concurrent saveNamespace. Contributed by Ming Ma. (cnauroth: rev d3268c4b10a0f728b554ddb6d69b666a9ca13f12)

            • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
            • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ImageServlet.java
            • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestStandbyCheckpoints.java
            • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java
            hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #816 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/816/ ) HDFS-3519 . Checkpoint upload may interfere with a concurrent saveNamespace. Contributed by Ming Ma. (cnauroth: rev d3268c4b10a0f728b554ddb6d69b666a9ca13f12) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ImageServlet.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestStandbyCheckpoints.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java
            hudson Hudson added a comment -

            FAILURE: Integrated in Hadoop-Hdfs-trunk #2014 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2014/)
            HDFS-3519. Checkpoint upload may interfere with a concurrent saveNamespace. Contributed by Ming Ma. (cnauroth: rev d3268c4b10a0f728b554ddb6d69b666a9ca13f12)

            • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestStandbyCheckpoints.java
            • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java
            • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ImageServlet.java
            • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
            hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2014 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2014/ ) HDFS-3519 . Checkpoint upload may interfere with a concurrent saveNamespace. Contributed by Ming Ma. (cnauroth: rev d3268c4b10a0f728b554ddb6d69b666a9ca13f12) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestStandbyCheckpoints.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ImageServlet.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
            hudson Hudson added a comment -

            FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #79 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/79/)
            HDFS-3519. Checkpoint upload may interfere with a concurrent saveNamespace. Contributed by Ming Ma. (cnauroth: rev d3268c4b10a0f728b554ddb6d69b666a9ca13f12)

            • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
            • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestStandbyCheckpoints.java
            • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ImageServlet.java
            • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java
            hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #79 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/79/ ) HDFS-3519 . Checkpoint upload may interfere with a concurrent saveNamespace. Contributed by Ming Ma. (cnauroth: rev d3268c4b10a0f728b554ddb6d69b666a9ca13f12) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestStandbyCheckpoints.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ImageServlet.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java
            hudson Hudson added a comment -

            FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #83 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/83/)
            HDFS-3519. Checkpoint upload may interfere with a concurrent saveNamespace. Contributed by Ming Ma. (cnauroth: rev d3268c4b10a0f728b554ddb6d69b666a9ca13f12)

            • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ImageServlet.java
            • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
            • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestStandbyCheckpoints.java
            • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java
            hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #83 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/83/ ) HDFS-3519 . Checkpoint upload may interfere with a concurrent saveNamespace. Contributed by Ming Ma. (cnauroth: rev d3268c4b10a0f728b554ddb6d69b666a9ca13f12) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ImageServlet.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestStandbyCheckpoints.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java
            hudson Hudson added a comment -

            FAILURE: Integrated in Hadoop-Mapreduce-trunk #2033 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2033/)
            HDFS-3519. Checkpoint upload may interfere with a concurrent saveNamespace. Contributed by Ming Ma. (cnauroth: rev d3268c4b10a0f728b554ddb6d69b666a9ca13f12)

            • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestStandbyCheckpoints.java
            • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java
            • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ImageServlet.java
            • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
            hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2033 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2033/ ) HDFS-3519 . Checkpoint upload may interfere with a concurrent saveNamespace. Contributed by Ming Ma. (cnauroth: rev d3268c4b10a0f728b554ddb6d69b666a9ca13f12) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestStandbyCheckpoints.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ImageServlet.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

            People

              mingma Ming Ma
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: