Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-3765

Namenode INITIALIZESHAREDEDITS should be able to initialize all shared storages

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha, 3.0.0
    • Fix Version/s: 2.0.2-alpha
    • Component/s: ha
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently, NameNode INITIALIZESHAREDEDITS provides ability to copy the edits files to file schema based shared storages when moving cluster from Non-HA environment to HA enabled environment.

      This Jira focuses on the following

      • Generalizing the logic of copying the edits to new shared storage so that any schema based shared storage can initialized for HA cluster.
      1. hdfs-3765-branch-2.txt
        16 kB
        Todd Lipcon
      2. hdfs-3765.txt
        16 kB
        Todd Lipcon
      3. hdfs-3765.txt
        16 kB
        Todd Lipcon
      4. HDFS-3765.patch
        12 kB
        Vinayakumar B
      5. hdfs-3765.txt
        13 kB
        Todd Lipcon
      6. HDFS-3765.patch
        11 kB
        Vinayakumar B
      7. HDFS-3765.patch
        7 kB
        Vinayakumar B

        Issue Links

          Activity

          Hide
          Vinayakumar B added a comment -

          Attached the patch for the same.

          Show
          Vinayakumar B added a comment - Attached the patch for the same.
          Hide
          Todd Lipcon added a comment -

          Hey Vinay. Thanks a lot for doing this - it's been on my list but hadn't gotten to it yet. Do you plan to add a test case, perhaps against the BKJM implementation?

          I'll look at the code as soon as I can.

          Show
          Todd Lipcon added a comment - Hey Vinay. Thanks a lot for doing this - it's been on my list but hadn't gotten to it yet. Do you plan to add a test case, perhaps against the BKJM implementation? I'll look at the code as soon as I can.
          Hide
          Todd Lipcon added a comment -

          Code looks pretty reasonable. But I think we should separate this into two separate patches. I'm not 100% convinced the "copy from one edits storage to another" should be lumped in with "initializeSharedEdits". Would you mind doing just the genericizing part in this JIRA and we can discuss the other use case separately?

          Also, please add a test which uses this new facility to initialize BKJM edits, if you don't mind.

          Show
          Todd Lipcon added a comment - Code looks pretty reasonable. But I think we should separate this into two separate patches. I'm not 100% convinced the "copy from one edits storage to another" should be lumped in with "initializeSharedEdits". Would you mind doing just the genericizing part in this JIRA and we can discuss the other use case separately? Also, please add a test which uses this new facility to initialize BKJM edits, if you don't mind.
          Hide
          Vinayakumar B added a comment -

          Thanks a lot Todd for taking a look.

          I'm not 100% convinced the "copy from one edits storage to another" should be lumped in with "initializeSharedEdits"

          If you feel we can handle this in separate jira, then fine. I will concentrate only on the genericizing part.

          Also, please add a test which uses this new facility to initialize BKJM edits, if you don't mind.

          Sure, I will try to add a testcase in BKJM contrib module.

          Show
          Vinayakumar B added a comment - Thanks a lot Todd for taking a look. I'm not 100% convinced the "copy from one edits storage to another" should be lumped in with "initializeSharedEdits" If you feel we can handle this in separate jira, then fine. I will concentrate only on the genericizing part. Also, please add a test which uses this new facility to initialize BKJM edits, if you don't mind. Sure, I will try to add a testcase in BKJM contrib module.
          Hide
          Vinayakumar B added a comment -

          Attaching the patch with comments fixed.

          Show
          Vinayakumar B added a comment - Attaching the patch with comments fixed.
          Hide
          Todd Lipcon added a comment -

          + * Use NameNode INTIALIZESHAREDEDITS to initialize the shared edits. i.e. copy
          + * the edits log segments to new bkjm shared edits.
          + *
          + * @throws Exception

          nits:

          • "NameNode -initializeSharedEdits" (the command is not generally typed in all caps)
          • capitalize BKJM
          • no need for "@throws Exception" since it's redundant with the signature itself

          +          newSharedEditLog.logEdit(op);
          +          newSharedEditLog.logSync();
          

          Calling logSync on every edit will make this take a really long time if there are a non-trivial number of edits to copy. Instead, I think you can avoid calling logSync, and instead rely on the "automatic sync" feature of the edit streams to trigger a logSync when the buffer grows too large.

          Otherwise looks great.

          Show
          Todd Lipcon added a comment - + * Use NameNode INTIALIZESHAREDEDITS to initialize the shared edits. i.e. copy + * the edits log segments to new bkjm shared edits. + * + * @throws Exception nits: "NameNode -initializeSharedEdits" (the command is not generally typed in all caps) capitalize BKJM no need for "@throws Exception" since it's redundant with the signature itself + newSharedEditLog.logEdit(op); + newSharedEditLog.logSync(); Calling logSync on every edit will make this take a really long time if there are a non-trivial number of edits to copy. Instead, I think you can avoid calling logSync, and instead rely on the "automatic sync" feature of the edit streams to trigger a logSync when the buffer grows too large. Otherwise looks great.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12539883/HDFS-3765.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 2 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal:

          org.apache.hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits
          org.apache.hadoop.contrib.bkjournal.TestBookKeeperAsHASharedDir

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2972//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2972//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12539883/HDFS-3765.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 2 new or modified test files. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 javadoc. The javadoc tool did not generate any warning messages. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal: org.apache.hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits org.apache.hadoop.contrib.bkjournal.TestBookKeeperAsHASharedDir +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2972//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2972//console This message is automatically generated.
          Hide
          Todd Lipcon added a comment -

          Seems it's not passing its unit tests. I think the code needs to look like this instead:

                  newSharedEditLog.logEdit(op);
          
                  if (op.opCode == FSEditLogOpCodes.OP_END_LOG_SEGMENT) {
                    newSharedEditLog.endCurrentLogSegment(true);
                    break;
                  }
          

          Otherwise the END_LOG_SEGMENT transaction doesn't end up logged in shared edits, and you end up with a one-op gap in between every segment.

          Show
          Todd Lipcon added a comment - Seems it's not passing its unit tests. I think the code needs to look like this instead: newSharedEditLog.logEdit(op); if (op.opCode == FSEditLogOpCodes.OP_END_LOG_SEGMENT) { newSharedEditLog.endCurrentLogSegment( true ); break ; } Otherwise the END_LOG_SEGMENT transaction doesn't end up logged in shared edits, and you end up with a one-op gap in between every segment.
          Hide
          Todd Lipcon added a comment -

          Oh, and please remove the now-unused imports in NameNode.java as well.

          Show
          Todd Lipcon added a comment - Oh, and please remove the now-unused imports in NameNode.java as well.
          Hide
          Todd Lipcon added a comment -

          here's a rev with some of the above changes. Also fixed TestBookKeeperAsHASharedDir to properly reset the ExitException in a @Before method.

          Show
          Todd Lipcon added a comment - here's a rev with some of the above changes. Also fixed TestBookKeeperAsHASharedDir to properly reset the ExitException in a @Before method.
          Hide
          Vinayakumar B added a comment -

          "NameNode -initializeSharedEdits" (the command is not generally typed in all caps)
          capitalize BKJM
          no need for "@throws Exception" since it's redundant with the signature itself

          Ok. I will do it.

          Calling logSync on every edit will make this take a really long time if there are a non-trivial number of edits to copy. Instead, I think you can avoid calling logSync, and instead rely on the "automatic sync" feature of the edit streams to trigger a logSync when the buffer grows too large.

          Ok. I will use "automatic sync"

          Otherwise the END_LOG_SEGMENT transaction doesn't end up logged in shared edits, and you end up with a one-op gap in between every segment.

          Here newSharedEditLog.endCurrentLogSegment(true) call itself will log END_LOG_SEGMENT based on the boolean we passed.
          Here is the code inside FSEditLog.endCurrentLogSegment(boolean)

          if (writeEndTxn) {
                logEdit(LogSegmentOp.getInstance(cache.get(), 
                    FSEditLogOpCodes.OP_END_LOG_SEGMENT));
                logSync();
              }

          No need to explicitly write END_LOG_SEGMENT op.

          Oh, and please remove the now-unused imports in NameNode.java as well.

          Sure.

          Here's a rev with some of the above changes. Also fixed TestBookKeeperAsHASharedDir to properly reset the ExitException in a @Before method.

          Here I didn't find method ExitUtil.resetFirstExitException() in ExitUtil.java

          I had run the same Unit tests, all had passed here. Anyway I will run unit tests one more time, before posting the patch.

          Show
          Vinayakumar B added a comment - "NameNode -initializeSharedEdits" (the command is not generally typed in all caps) capitalize BKJM no need for "@throws Exception" since it's redundant with the signature itself Ok. I will do it. Calling logSync on every edit will make this take a really long time if there are a non-trivial number of edits to copy. Instead, I think you can avoid calling logSync, and instead rely on the "automatic sync" feature of the edit streams to trigger a logSync when the buffer grows too large. Ok. I will use "automatic sync" Otherwise the END_LOG_SEGMENT transaction doesn't end up logged in shared edits, and you end up with a one-op gap in between every segment. Here newSharedEditLog.endCurrentLogSegment(true) call itself will log END_LOG_SEGMENT based on the boolean we passed. Here is the code inside FSEditLog.endCurrentLogSegment(boolean) if (writeEndTxn) { logEdit(LogSegmentOp.getInstance(cache.get(), FSEditLogOpCodes.OP_END_LOG_SEGMENT)); logSync(); } No need to explicitly write END_LOG_SEGMENT op. Oh, and please remove the now-unused imports in NameNode.java as well. Sure. Here's a rev with some of the above changes. Also fixed TestBookKeeperAsHASharedDir to properly reset the ExitException in a @Before method. Here I didn't find method ExitUtil.resetFirstExitException() in ExitUtil.java I had run the same Unit tests, all had passed here. Anyway I will run unit tests one more time, before posting the patch.
          Hide
          Vinayakumar B added a comment -

          Attaching the patch with fixed comments

          Show
          Vinayakumar B added a comment - Attaching the patch with fixed comments
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12540034/HDFS-3765.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 2 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal:

          org.apache.hadoop.hdfs.TestFileConcurrentReader
          org.apache.hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits
          org.apache.hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
          org.apache.hadoop.contrib.bkjournal.TestBookKeeperAsHASharedDir

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2982//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2982//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12540034/HDFS-3765.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 2 new or modified test files. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 javadoc. The javadoc tool did not generate any warning messages. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal: org.apache.hadoop.hdfs.TestFileConcurrentReader org.apache.hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits org.apache.hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics org.apache.hadoop.contrib.bkjournal.TestBookKeeperAsHASharedDir +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2982//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2982//console This message is automatically generated.
          Hide
          Todd Lipcon added a comment -

          New rev based on Vinay's, with a few more fixes:

          • include the reset method for ExitUtil so the test can pass
          • dont allow InitializeSharedEdits to run when no shared edits are configured
          • fix for initializeSharedEdits to work when checkpoints are not on segment boundaries – the previous assertion there wasn't correct
          • add debug/trace logging, which was helpful for debugging the above
          • fix a bug where an extra END_LOG_SEGMENT would get inserted when the source logs had an END_LOG_SEGMENT
          • call recoverClosedStreams() before writing to shared edits - necessary for QJM, since the recovery phase has to run before a write phase
          • unset the shared edits in the "source" image - otherwise it will fail to read from an unformatted journal for some JMs

          I've been testing this with QJM and it seems to work well.

          Show
          Todd Lipcon added a comment - New rev based on Vinay's, with a few more fixes: include the reset method for ExitUtil so the test can pass dont allow InitializeSharedEdits to run when no shared edits are configured fix for initializeSharedEdits to work when checkpoints are not on segment boundaries – the previous assertion there wasn't correct add debug/trace logging, which was helpful for debugging the above fix a bug where an extra END_LOG_SEGMENT would get inserted when the source logs had an END_LOG_SEGMENT call recoverClosedStreams() before writing to shared edits - necessary for QJM, since the recovery phase has to run before a write phase unset the shared edits in the "source" image - otherwise it will fail to read from an unformatted journal for some JMs I've been testing this with QJM and it seems to work well.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12540160/hdfs-3765.txt
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 3 new or modified test files.

          -1 javac. The patch appears to cause the build to fail.

          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2984//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12540160/hdfs-3765.txt against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified test files. -1 javac. The patch appears to cause the build to fail. Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2984//console This message is automatically generated.
          Hide
          Vinayakumar B added a comment -

          Oh!! I didn't realize that FSEditLog.startLogSegment(long, boolean) has changed behaviour in trunk version. So I was thinking START_LOG_SEGMENT op will be added automatically as in branch-2.

          Anyway, thanks todd for the latest fixes.

          +1, patch looks great.
          I am not sure why QA is failing.

          Show
          Vinayakumar B added a comment - Oh!! I didn't realize that FSEditLog.startLogSegment(long, boolean) has changed behaviour in trunk version. So I was thinking START_LOG_SEGMENT op will be added automatically as in branch-2. Anyway, thanks todd for the latest fixes. +1, patch looks great. I am not sure why QA is failing.
          Hide
          Todd Lipcon added a comment -

          Trying patch upload again... this applies clean on trunk for me.

          Show
          Todd Lipcon added a comment - Trying patch upload again... this applies clean on trunk for me.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12540746/hdfs-3765.txt
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 3 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          -1 findbugs. The patch appears to introduce 2 new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2995//testReport/
          Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/2995//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-hdfs.html
          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2995//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12540746/hdfs-3765.txt against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified test files. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 javadoc. The javadoc tool did not generate any warning messages. +1 eclipse:eclipse. The patch built with eclipse:eclipse. -1 findbugs. The patch appears to introduce 2 new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal. +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2995//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/2995//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-hdfs.html Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2995//console This message is automatically generated.
          Hide
          Todd Lipcon added a comment -

          The findbugs warnings are from HDFS-3695. They have already been fixed in HDFS-3792 (committed just before this QA report)

          Show
          Todd Lipcon added a comment - The findbugs warnings are from HDFS-3695 . They have already been fixed in HDFS-3792 (committed just before this QA report)
          Hide
          Aaron T. Myers added a comment -

          +1, the latest patch looks good to me.

          Show
          Aaron T. Myers added a comment - +1, the latest patch looks good to me.
          Hide
          Todd Lipcon added a comment -

          Attaching branch-2 patch. It's the same except for some resolved conflicts on the imports.

          Will commit both patches momentarily. Thanks, Vinay.

          Show
          Todd Lipcon added a comment - Attaching branch-2 patch. It's the same except for some resolved conflicts on the imports. Will commit both patches momentarily. Thanks, Vinay.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #2600 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2600/)
          HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon. (Revision 1373061)

          Result = FAILURE
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1373061
          Files :

          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ExitUtil.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperAsHASharedDir.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/HATestUtil.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestInitializeSharedEdits.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #2600 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2600/ ) HDFS-3765 . namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon. (Revision 1373061) Result = FAILURE todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1373061 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ExitUtil.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperAsHASharedDir.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/HATestUtil.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestInitializeSharedEdits.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk-Commit #2577 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2577/)
          HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon. (Revision 1373061)

          Result = SUCCESS
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1373061
          Files :

          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ExitUtil.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperAsHASharedDir.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/HATestUtil.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestInitializeSharedEdits.java
          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #2577 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2577/ ) HDFS-3765 . namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon. (Revision 1373061) Result = SUCCESS todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1373061 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ExitUtil.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperAsHASharedDir.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/HATestUtil.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestInitializeSharedEdits.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #2642 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2642/)
          HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon. (Revision 1373061)

          Result = FAILURE
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1373061
          Files :

          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ExitUtil.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperAsHASharedDir.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/HATestUtil.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestInitializeSharedEdits.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #2642 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2642/ ) HDFS-3765 . namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon. (Revision 1373061) Result = FAILURE todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1373061 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ExitUtil.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperAsHASharedDir.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/HATestUtil.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestInitializeSharedEdits.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #1135 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1135/)
          HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon. (Revision 1373061)

          Result = FAILURE
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1373061
          Files :

          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ExitUtil.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperAsHASharedDir.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/HATestUtil.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestInitializeSharedEdits.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #1135 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1135/ ) HDFS-3765 . namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon. (Revision 1373061) Result = FAILURE todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1373061 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ExitUtil.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperAsHASharedDir.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/HATestUtil.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestInitializeSharedEdits.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #1167 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1167/)
          HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon. (Revision 1373061)

          Result = FAILURE
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1373061
          Files :

          • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ExitUtil.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperAsHASharedDir.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/HATestUtil.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestInitializeSharedEdits.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #1167 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1167/ ) HDFS-3765 . namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon. (Revision 1373061) Result = FAILURE todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1373061 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/ExitUtil.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/src/test/java/org/apache/hadoop/contrib/bkjournal/TestBookKeeperAsHASharedDir.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/HATestUtil.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestInitializeSharedEdits.java

            People

            • Assignee:
              Vinayakumar B
              Reporter:
              Vinayakumar B
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development