Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
I saw a case when the SecondaryNamenode encountered a OutOfMemory exception because the fsimage and edits file were too big to fit into the Secondary Namenode's memory. However, the process did not exit.
Exception in thread "org.apache.hadoop.dfs.SecondaryNameNode@73eb904d" java.lang.OutOfMemoryError: GC overhead limit
exceeded
at java.lang.AbstractStringBuilder.<init>(AbstractStringBuilder.java:45)
at java.lang.StringBuffer.<init>(StringBuffer.java:91)
at org.apache.hadoop.io.UTF8.toString(UTF8.java:129)
at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:692)
at org.apache.hadoop.dfs.SecondaryNameNode.doMerge(SecondaryNameNode.java:304)
at org.apache.hadoop.dfs.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:273)
at org.apache.hadoop.dfs.SecondaryNameNode.run(SecondaryNameNode.java:190)
at java.lang.Thread.run(Thread.java:619)