Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-309

FSEditLog should log progress during replay

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.0-alpha
    • Component/s: None
    • Labels:
    • Hadoop Flags:
      Reviewed

      Description

      When the NameNode is replaying a long edit log, it's handy to have reports on how far through it is, so you can judge how much time it is remaining.

      1. HDFS-309.txt
        3 kB
        Sho Shimauchi
      2. HDFS-309.txt
        4 kB
        Sho Shimauchi
      3. HDFS-309.txt
        4 kB
        Sho Shimauchi
      4. HDFS-309.txt
        4 kB
        Sho Shimauchi

        Issue Links

          Activity

          Hide
          Sho Shimauchi added a comment -

          FSEditLogOp.toString() is required to print log messages.

          Show
          Sho Shimauchi added a comment - FSEditLogOp.toString() is required to print log messages.
          Hide
          Sho Shimauchi added a comment -

          attached patch.
          replay log will be generated like this:

          2012-02-25 19:40:30,768 DEBUG namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(118)) - Acquiring write lock to replay edit log
          2012-02-25 19:40:30,768 DEBUG namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(134)) - replaying edit log: LogSegmentOp [opCode=OP_START_LOG_SEGMENT, txid=1]
          2012-02-25 19:40:30,769 DEBUG namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(134)) - replaying edit log: SetGenstampOp [genStamp=1001, opCode=OP_SET_GENSTAMP, txid=2]
          2012-02-25 19:40:30,769 DEBUG namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(134)) - replaying edit log: AddOp [length=0, path=/testfile, replication=1, mtime=1330166430268, atime=1330166430268, blockSize=67108864, blocks=[], permissions=sho:supergroup:rw-r-r-, clientName=DFSClient_NONMAPREDUCE_1990794058_1, clientMachine=127.0.0.1, opCode=OP_ADD, txid=3]
          2012-02-25 19:40:30,771 DEBUG namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(134)) - replaying edit log: CloseOp [length=0, path=/testfile, replication=1, mtime=1330166430481, atime=1330166430268, blockSize=67108864, blocks=[blk_1906532225227800470_1001], permissions=sho:supergroup:rw-r-r-, clientName=, clientMachine=, opCode=OP_CLOSE, txid=4]
          2012-02-25 19:40:30,771 DEBUG namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(134)) - replaying edit log: LogSegmentOp [opCode=OP_END_LOG_SEGMENT, txid=5]
          2012-02-25 19:40:30,771 DEBUG namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(436)) - replaying edit log finished

          Show
          Sho Shimauchi added a comment - attached patch. replay log will be generated like this: 2012-02-25 19:40:30,768 DEBUG namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(118)) - Acquiring write lock to replay edit log 2012-02-25 19:40:30,768 DEBUG namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(134)) - replaying edit log: LogSegmentOp [opCode=OP_START_LOG_SEGMENT, txid=1] 2012-02-25 19:40:30,769 DEBUG namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(134)) - replaying edit log: SetGenstampOp [genStamp=1001, opCode=OP_SET_GENSTAMP, txid=2] 2012-02-25 19:40:30,769 DEBUG namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(134)) - replaying edit log: AddOp [length=0, path=/testfile, replication=1, mtime=1330166430268, atime=1330166430268, blockSize=67108864, blocks=[], permissions=sho:supergroup:rw-r- r -, clientName=DFSClient_NONMAPREDUCE_1990794058_1, clientMachine=127.0.0.1, opCode=OP_ADD, txid=3] 2012-02-25 19:40:30,771 DEBUG namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(134)) - replaying edit log: CloseOp [length=0, path=/testfile, replication=1, mtime=1330166430481, atime=1330166430268, blockSize=67108864, blocks= [blk_1906532225227800470_1001] , permissions=sho:supergroup:rw-r- r -, clientName=, clientMachine=, opCode=OP_CLOSE, txid=4] 2012-02-25 19:40:30,771 DEBUG namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(134)) - replaying edit log: LogSegmentOp [opCode=OP_END_LOG_SEGMENT, txid=5] 2012-02-25 19:40:30,771 DEBUG namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(436)) - replaying edit log finished
          Hide
          Todd Lipcon added a comment -

          Having this trace information seems useful – but a bit too verbose. How about we make the full trace happen at TRACE level (LOG.isTraceEnabled()), but at INFO level periodically log something like:
          replaying edit log: completed 1000/40000 transactions (3%)

          Show
          Todd Lipcon added a comment - Having this trace information seems useful – but a bit too verbose. How about we make the full trace happen at TRACE level (LOG.isTraceEnabled()), but at INFO level periodically log something like: replaying edit log: completed 1000/40000 transactions (3%)
          Hide
          Sho Shimauchi added a comment -

          Thanks for feedback!
          I updated the patch.

          The output is now like this:

          2012-02-29 02:05:20,619 INFO namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(118)) - Acquiring write lock to replay edit log
          2012-02-29 02:05:20,625 DEBUG namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(127)) - edit log length: 1232, first txid: 1, last txid: 23
          2012-02-29 02:05:20,637 INFO namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(421)) - replaying edit log: 12/23 transactions completed. (52%)

          This replay progress message is printed once every second.

          Show
          Sho Shimauchi added a comment - Thanks for feedback! I updated the patch. The output is now like this: 2012-02-29 02:05:20,619 INFO namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(118)) - Acquiring write lock to replay edit log 2012-02-29 02:05:20,625 DEBUG namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(127)) - edit log length: 1232, first txid: 1, last txid: 23 2012-02-29 02:05:20,637 INFO namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(421)) - replaying edit log: 12/23 transactions completed. (52%) This replay progress message is printed once every second.
          Hide
          Todd Lipcon added a comment -
          +    LOG.info("Acquiring write lock to replay edit log");
          +
          

          seems like it should be a TRACE, or just deleted.


          • numOfTxs - please rename to numTxns to match style used elsewhere
          • similary, currentTx should be currentTxId

          +          // replay progress log
          
          • I think better to write "log progress"
          • Is it possible to somehow find the path of the log being replayed? I think the EditLogInputStream should stringify itself correctly. This way we could include the path in the log output, which is helpful since there may be multiple segments that need to be replayed.
          Show
          Todd Lipcon added a comment - + LOG.info( "Acquiring write lock to replay edit log" ); + seems like it should be a TRACE, or just deleted. numOfTxs - please rename to numTxns to match style used elsewhere similary, currentTx should be currentTxId + // replay progress log I think better to write "log progress" Is it possible to somehow find the path of the log being replayed? I think the EditLogInputStream should stringify itself correctly. This way we could include the path in the log output, which is helpful since there may be multiple segments that need to be replayed.
          Hide
          Sho Shimauchi added a comment -

          > seems like it should be a TRACE, or just deleted.
          There are two reason to print such a log before writeLock():

          • it's possible that writeLock() fails to lock. If this log is printed, we can check if this happens or not.
          • Saying explicitly why write lock is grabbed is informative.

          This information is useful for developer rather than user, so I'll lower the log level to TRACE.
          Does this sound good?

          > Is it possible to somehow find the path of the log being replayed?
          File path can be got from EditLogInputStream.getName() , but it's a bit verbose because FSImage output the file path too.
          I've already printed the file path in FSEditLogLoader in below:

          2012-02-29 23:04:19,368 DEBUG namenode.FSImage (FSImage.java:loadEdits(649)) - About to load edits:
          /Users/sho/src/apache/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/build/test/data/dfs/name1/current/edits_0000000000000000001-0000000000000000023
          2012-02-29 23:04:19,369 INFO namenode.FSImage (FSImage.java:loadEdits(659)) - Reading /Users/sho/src/apache/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/build/test/data/dfs/name1/current/edits_0000000000000000001-0000000000000000023 expecting start txid #1
          2012-02-29 23:04:19,369 INFO namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(118)) - Acquiring write lock to replay edit log
          2012-02-29 23:04:19,370 DEBUG namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(127)) - edit log length: 1232, first txid: 1, last txid: 23, name: /Users/sho/src/apache/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/build/test/data/dfs/name1/current/edits_0000000000000000001-0000000000000000023
          2012-02-29 23:04:19,371 TRACE namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(145)) - replaying edit log: LogSegmentOp [opCode=OP_START_LOG_SEGMENT, txid=1]

          I agree with other point. I'll fix them and update the patch.
          Thanks for feedback!

          Show
          Sho Shimauchi added a comment - > seems like it should be a TRACE, or just deleted. There are two reason to print such a log before writeLock(): it's possible that writeLock() fails to lock. If this log is printed, we can check if this happens or not. Saying explicitly why write lock is grabbed is informative. This information is useful for developer rather than user, so I'll lower the log level to TRACE. Does this sound good? > Is it possible to somehow find the path of the log being replayed? File path can be got from EditLogInputStream.getName() , but it's a bit verbose because FSImage output the file path too. I've already printed the file path in FSEditLogLoader in below: 2012-02-29 23:04:19,368 DEBUG namenode.FSImage (FSImage.java:loadEdits(649)) - About to load edits: /Users/sho/src/apache/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/build/test/data/dfs/name1/current/edits_0000000000000000001-0000000000000000023 2012-02-29 23:04:19,369 INFO namenode.FSImage (FSImage.java:loadEdits(659)) - Reading /Users/sho/src/apache/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/build/test/data/dfs/name1/current/edits_0000000000000000001-0000000000000000023 expecting start txid #1 2012-02-29 23:04:19,369 INFO namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(118)) - Acquiring write lock to replay edit log 2012-02-29 23:04:19,370 DEBUG namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(127)) - edit log length: 1232, first txid: 1, last txid: 23, name: /Users/sho/src/apache/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/build/test/data/dfs/name1/current/edits_0000000000000000001-0000000000000000023 2012-02-29 23:04:19,371 TRACE namenode.FSEditLogLoader (FSEditLogLoader.java:loadEditRecords(145)) - replaying edit log: LogSegmentOp [opCode=OP_START_LOG_SEGMENT, txid=1] I agree with other point. I'll fix them and update the patch. Thanks for feedback!
          Hide
          Sho Shimauchi added a comment -

          fixed

          Show
          Sho Shimauchi added a comment - fixed
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12516565/HDFS-309.txt
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 3 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          -1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in .

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/1938//testReport/
          Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/1938//artifact/trunk/hadoop-hdfs-project/patchprocess/newPatchFindbugsWarningshadoop-hdfs.html
          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/1938//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12516565/HDFS-309.txt against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. -1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/1938//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/1938//artifact/trunk/hadoop-hdfs-project/patchprocess/newPatchFindbugsWarningshadoop-hdfs.html Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/1938//console This message is automatically generated.
          Hide
          Todd Lipcon added a comment -

          Hi Sho. This patch fell out of date when we merged the HA branch, I believe. Would you mind updating it against the current trunk?

          Show
          Todd Lipcon added a comment - Hi Sho. This patch fell out of date when we merged the HA branch, I believe. Would you mind updating it against the current trunk?
          Hide
          Sho Shimauchi added a comment -

          Sure.
          I updated the patch to be able to be merged into trunk.

          Show
          Sho Shimauchi added a comment - Sure. I updated the patch to be able to be merged into trunk.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12519215/HDFS-309.txt
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 3 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests:
          org.apache.hadoop.hdfs.TestAppendDifferentChecksum
          org.apache.hadoop.hdfs.server.namenode.TestValidateConfigurationSettings

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2062//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2062//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12519215/HDFS-309.txt against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests: org.apache.hadoop.hdfs.TestAppendDifferentChecksum org.apache.hadoop.hdfs.server.namenode.TestValidateConfigurationSettings +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2062//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2062//console This message is automatically generated.
          Hide
          Sho Shimauchi added a comment -

          Jenkins test failed for other reason.

          https://builds.apache.org/job/Hadoop-Hdfs-trunk/991/

          Show
          Sho Shimauchi added a comment - Jenkins test failed for other reason. https://builds.apache.org/job/Hadoop-Hdfs-trunk/991/
          Hide
          Todd Lipcon added a comment -

          Committed to branch-23 and trunk. Thanks Sho!

          Show
          Todd Lipcon added a comment - Committed to branch-23 and trunk. Thanks Sho!
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-0.23-Commit #711 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/711/)
          HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303482)

          Result = SUCCESS
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303482
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Show
          Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #711 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/711/ ) HDFS-309 . FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303482) Result = SUCCESS todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303482 Files : /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk-Commit #1912 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1912/)
          HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303485)

          Result = SUCCESS
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303485
          Files :

          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1912 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1912/ ) HDFS-309 . FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303485) Result = SUCCESS todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303485 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #1986 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1986/)
          HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303485)

          Result = SUCCESS
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303485
          Files :

          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1986 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1986/ ) HDFS-309 . FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303485) Result = SUCCESS todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303485 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-0.23-Commit #702 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/702/)
          HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303482)

          Result = SUCCESS
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303482
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #702 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/702/ ) HDFS-309 . FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303482) Result = SUCCESS todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303482 Files : /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-0.23-Commit #719 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/719/)
          HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303482)

          Result = ABORTED
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303482
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #719 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/719/ ) HDFS-309 . FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303482) Result = ABORTED todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303482 Files : /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #1921 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1921/)
          HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303485)

          Result = ABORTED
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303485
          Files :

          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1921 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1921/ ) HDFS-309 . FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303485) Result = ABORTED todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303485 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #992 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/992/)
          HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303485)

          Result = FAILURE
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303485
          Files :

          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #992 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/992/ ) HDFS-309 . FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303485) Result = FAILURE todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303485 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-0.23-Build #205 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/205/)
          HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303482)

          Result = SUCCESS
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303482
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #205 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/205/ ) HDFS-309 . FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303482) Result = SUCCESS todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303482 Files : /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-0.23-Build #233 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/233/)
          HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303482)

          Result = FAILURE
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303482
          Files :

          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
          • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #233 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/233/ ) HDFS-309 . FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303482) Result = FAILURE todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303482 Files : /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #1027 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1027/)
          HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303485)

          Result = SUCCESS
          todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303485
          Files :

          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
          • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #1027 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1027/ ) HDFS-309 . FSEditLog should log progress during replay. Contributed by Sho Shimauchi. (Revision 1303485) Result = SUCCESS todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303485 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSEditLogLoader.java

            People

            • Assignee:
              Sho Shimauchi
              Reporter:
              Todd Lipcon
            • Votes:
              2 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development