Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-4182

SecondaryNameNode leaks NameCache entries

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.4, 3.0.0, 2.0.2-alpha
    • Fix Version/s: 3.0.0, 2.0.3-alpha, 0.23.5
    • Component/s: namenode
    • Labels:
      None

      Description

      We recently saw an issue where a 2NN ran out of memory, even though it had a relatively small fsimage. When we looked at the heap dump, we saw that all of the memory had gone to entries in the NameCache.

      It appears that the NameCache is staying in "initializing" mode forever, and therefore a long running 2NN leaks entries.

      1. HDFS-4182.txt
        5 kB
        Robert Joseph Evans
      2. HDFS-4182.txt
        5 kB
        Robert Joseph Evans
      3. HDFS-4182.txt
        5 kB
        Robert Joseph Evans
      4. HDFS-4182.txt
        3 kB
        Robert Joseph Evans
      5. HDFS-4182-branch-0.23.txt
        5 kB
        Robert Joseph Evans

        Activity

        Hide
        Todd Lipcon added a comment -

        Seems like it might be enough to just re-initialize the NameCache in FSDirectory.reset(), and then ensure that after the image load is complete in the 2NN that we call NameCache.initialized().

        Show
        Todd Lipcon added a comment - Seems like it might be enough to just re-initialize the NameCache in FSDirectory.reset() , and then ensure that after the image load is complete in the 2NN that we call NameCache.initialized() .
        Hide
        Robert Joseph Evans added a comment -

        Todd,

        Are you working on a patch for this? It seems critical enough that I really would like to get a patch in for 0.23.5. But I also don't want to start working on something if you are already doing it.

        Show
        Robert Joseph Evans added a comment - Todd, Are you working on a patch for this? It seems critical enough that I really would like to get a patch in for 0.23.5. But I also don't want to start working on something if you are already doing it.
        Hide
        Todd Lipcon added a comment -

        Hi Robert. Nope, I haven't started working on it, so feel free to pick it up. Thanks

        Show
        Todd Lipcon added a comment - Hi Robert. Nope, I haven't started working on it, so feel free to pick it up. Thanks
        Hide
        Robert Joseph Evans added a comment -

        The patch I am attaching does not include any tests yet. I wanted to see if the direction I was going in seemed OK. I changed FSDirectory.reset to also reset the NameCache and mark the directory as not ready.

        Then in the SecondaryNameNode after loading the new image it informs the FSDirectory that the image was loaded.

        I am going to run some manual tests and then see if I can write some unit tests for it.

        Show
        Robert Joseph Evans added a comment - The patch I am attaching does not include any tests yet. I wanted to see if the direction I was going in seemed OK. I changed FSDirectory.reset to also reset the NameCache and mark the directory as not ready. Then in the SecondaryNameNode after loading the new image it informs the FSDirectory that the image was loaded. I am going to run some manual tests and then see if I can write some unit tests for it.
        Hide
        Todd Lipcon added a comment -

        Seems reasonable to me. I agree some tests would be nice.

        Show
        Todd Lipcon added a comment - Seems reasonable to me. I agree some tests would be nice.
        Hide
        Aaron T. Myers added a comment -

        Seems fine to me. Alternatively we could just make the 2NN completely disable the NameCache. I don't think most folks are as concerned with their checkpointing time as they are concerned with their NN startup time. Either way is certainly fine though.

        Show
        Aaron T. Myers added a comment - Seems fine to me. Alternatively we could just make the 2NN completely disable the NameCache. I don't think most folks are as concerned with their checkpointing time as they are concerned with their NN startup time. Either way is certainly fine though.
        Hide
        Robert Joseph Evans added a comment -

        Ya I thought about disabling the NameCache, because it is not really needed. If you think that would be less of an impact I am happy to switch over to that instead.

        Show
        Robert Joseph Evans added a comment - Ya I thought about disabling the NameCache, because it is not really needed. If you think that would be less of an impact I am happy to switch over to that instead.
        Hide
        Aaron T. Myers added a comment -

        It will probably be a little easier to implement, but I don't feel strongly about it. In ordinary operation a long-running 2NN doesn't actually load the fsimage every time it performs a checkpoint, so having the NameCache enabled won't actually do anything after the initial fsimage load.

        Show
        Aaron T. Myers added a comment - It will probably be a little easier to implement, but I don't feel strongly about it. In ordinary operation a long-running 2NN doesn't actually load the fsimage every time it performs a checkpoint, so having the NameCache enabled won't actually do anything after the initial fsimage load.
        Hide
        Suresh Srinivas added a comment -

        Ya I thought about disabling the NameCache, because it is not really needed. If you think that would be less of an impact I am happy to switch over to that instead.

        NameCache saves the memory used for repeated names in the namespace. Given most of the folks use same JVM heap sizes for primary and secondary, the optimizations from NameCache may be necessary. Secondary does not have block map related data and hence uses less java heap than primary. Despite this leaving it as is probably a good idea.

        Show
        Suresh Srinivas added a comment - Ya I thought about disabling the NameCache, because it is not really needed. If you think that would be less of an impact I am happy to switch over to that instead. NameCache saves the memory used for repeated names in the namespace. Given most of the folks use same JVM heap sizes for primary and secondary, the optimizations from NameCache may be necessary. Secondary does not have block map related data and hence uses less java heap than primary. Despite this leaving it as is probably a good idea.
        Hide
        Robert Joseph Evans added a comment -

        This patch fixes an NPE that was found by the existing unit tests and adds in some more tests to validate that the changes are working. I also manually brought up a cluster and saw that the NameCache moved out of initializing.

        Show
        Robert Joseph Evans added a comment - This patch fixes an NPE that was found by the existing unit tests and adds in some more tests to validate that the changes are working. I also manually brought up a cluster and saw that the NameCache moved out of initializing.
        Hide
        Kihwal Lee added a comment -

        +1 The patch looks good to me. This is minor, but you could add the VisibleForTesting annotation for the test-only method.

        Show
        Kihwal Lee added a comment - +1 The patch looks good to me. This is minor, but you could add the VisibleForTesting annotation for the test-only method.
        Hide
        Robert Joseph Evans added a comment -

        Adds in requested annotation.

        Show
        Robert Joseph Evans added a comment - Adds in requested annotation.
        Hide
        Suresh Srinivas added a comment -

        +1 for the patch. Minor cmments:

        1. Remove commented line: // cond.signalAll();
        2. empty line in TestFSDirectory.java
        Show
        Suresh Srinivas added a comment - +1 for the patch. Minor cmments: Remove commented line: // cond.signalAll(); empty line in TestFSDirectory.java
        Hide
        Robert Joseph Evans added a comment -

        Updated to address Suresh's comments.

        Show
        Robert Joseph Evans added a comment - Updated to address Suresh's comments.
        Hide
        Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12553514/HDFS-4182.txt
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 2 new or modified test files.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in hadoop-hdfs-project/hadoop-hdfs.

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/3501//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3501//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12553514/HDFS-4182.txt against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 2 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . The javadoc tool did not generate any warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-hdfs-project/hadoop-hdfs. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/3501//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3501//console This message is automatically generated.
        Hide
        Robert Joseph Evans added a comment - - edited

        Jenkins came back with a +1 and with a +1 for Suresh and a +1 for Kihwal, I will check this in.

        Show
        Robert Joseph Evans added a comment - - edited Jenkins came back with a +1 and with a +1 for Suresh and a +1 for Kihwal, I will check this in.
        Hide
        Hudson added a comment -

        Integrated in Hadoop-trunk-Commit #3018 (See https://builds.apache.org/job/Hadoop-trunk-Commit/3018/)
        HDFS-4182. SecondaryNameNode leaks NameCache entries (bobby) (Revision 1409311)

        Result = SUCCESS
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1409311
        Files :

        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameCache.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/SecondaryNameNode.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSDirectory.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameCache.java
        Show
        Hudson added a comment - Integrated in Hadoop-trunk-Commit #3018 (See https://builds.apache.org/job/Hadoop-trunk-Commit/3018/ ) HDFS-4182 . SecondaryNameNode leaks NameCache entries (bobby) (Revision 1409311) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1409311 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameCache.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/SecondaryNameNode.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSDirectory.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameCache.java
        Hide
        Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12553525/HDFS-4182.txt
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 2 new or modified test files.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in hadoop-hdfs-project/hadoop-hdfs.

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/3502//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3502//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12553525/HDFS-4182.txt against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 2 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . The javadoc tool did not generate any warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-hdfs-project/hadoop-hdfs. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/3502//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3502//console This message is automatically generated.
        Hide
        Robert Joseph Evans added a comment -

        The patch is in for trunk, and branch-2. I am working on a patch for branch-0.23 because there were merge conflicts. It looks like the leak exists there too.

        Show
        Robert Joseph Evans added a comment - The patch is in for trunk, and branch-2. I am working on a patch for branch-0.23 because there were merge conflicts. It looks like the leak exists there too.
        Hide
        Robert Joseph Evans added a comment -

        I am attaching the upmerged patch for review. I am still running the unit tests and manual tests to be sure that the leak is plugged.

        Show
        Robert Joseph Evans added a comment - I am attaching the upmerged patch for review. I am still running the unit tests and manual tests to be sure that the leak is plugged.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12553558/HDFS-4182-branch-0.23.txt
        against trunk revision .

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3504//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12553558/HDFS-4182-branch-0.23.txt against trunk revision . -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/3504//console This message is automatically generated.
        Hide
        Daryn Sharp added a comment -

        +1 I think it looks ok relative to the trunk patch. It seems like the image load notification shouldn't have to be duplicated in different places in the NN and 2NN, ie. pushed down lower, but given the current design I don't think that's possible.

        Show
        Daryn Sharp added a comment - +1 I think it looks ok relative to the trunk patch. It seems like the image load notification shouldn't have to be duplicated in different places in the NN and 2NN, ie. pushed down lower, but given the current design I don't think that's possible.
        Hide
        Robert Joseph Evans added a comment -

        All of the unit tests for branch-0.23 passed, so with Daryn's +1 I'll check this into branch-0.23 too.

        Show
        Robert Joseph Evans added a comment - All of the unit tests for branch-0.23 passed, so with Daryn's +1 I'll check this into branch-0.23 too.
        Hide
        Robert Joseph Evans added a comment -

        I put this into trunk, branch-2, and branch-0.23

        Show
        Robert Joseph Evans added a comment - I put this into trunk, branch-2, and branch-0.23
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Yarn-trunk #37 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/37/)
        HDFS-4182. SecondaryNameNode leaks NameCache entries (bobby) (Revision 1409311)

        Result = SUCCESS
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1409311
        Files :

        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameCache.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/SecondaryNameNode.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSDirectory.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameCache.java
        Show
        Hudson added a comment - Integrated in Hadoop-Yarn-trunk #37 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/37/ ) HDFS-4182 . SecondaryNameNode leaks NameCache entries (bobby) (Revision 1409311) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1409311 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameCache.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/SecondaryNameNode.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSDirectory.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameCache.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Build #436 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/436/)
        HDFS-4182. SecondaryNameNode leaks NameCache entries (bobby) (Revision 1409479)

        Result = SUCCESS
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1409479
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameCache.java
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/SecondaryNameNode.java
        • /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameCache.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #436 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/436/ ) HDFS-4182 . SecondaryNameNode leaks NameCache entries (bobby) (Revision 1409479) Result = SUCCESS bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1409479 Files : /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameCache.java /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/SecondaryNameNode.java /hadoop/common/branches/branch-0.23/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameCache.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #1227 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1227/)
        HDFS-4182. SecondaryNameNode leaks NameCache entries (bobby) (Revision 1409311)

        Result = FAILURE
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1409311
        Files :

        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameCache.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/SecondaryNameNode.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSDirectory.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameCache.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #1227 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1227/ ) HDFS-4182 . SecondaryNameNode leaks NameCache entries (bobby) (Revision 1409311) Result = FAILURE bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1409311 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameCache.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/SecondaryNameNode.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSDirectory.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameCache.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #1258 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1258/)
        HDFS-4182. SecondaryNameNode leaks NameCache entries (bobby) (Revision 1409311)

        Result = FAILURE
        bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1409311
        Files :

        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameCache.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/SecondaryNameNode.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSDirectory.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameCache.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #1258 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1258/ ) HDFS-4182 . SecondaryNameNode leaks NameCache entries (bobby) (Revision 1409311) Result = FAILURE bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1409311 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameCache.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/SecondaryNameNode.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSDirectory.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameCache.java

          People

          • Assignee:
            Robert Joseph Evans
            Reporter:
            Todd Lipcon
          • Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development