Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2209

SecondaryNamenode process should exit if it encounters Runtime exceptions

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.16.0
    • None
    • None

    Description

      I saw a case when the SecondaryNamenode encountered a OutOfMemory exception because the fsimage and edits file were too big to fit into the Secondary Namenode's memory. However, the process did not exit.

      Exception in thread "org.apache.hadoop.dfs.SecondaryNameNode@73eb904d" java.lang.OutOfMemoryError: GC overhead limit
      exceeded
      at java.lang.AbstractStringBuilder.<init>(AbstractStringBuilder.java:45)
      at java.lang.StringBuffer.<init>(StringBuffer.java:91)
      at org.apache.hadoop.io.UTF8.toString(UTF8.java:129)
      at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:692)
      at org.apache.hadoop.dfs.SecondaryNameNode.doMerge(SecondaryNameNode.java:304)
      at org.apache.hadoop.dfs.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:273)
      at org.apache.hadoop.dfs.SecondaryNameNode.run(SecondaryNameNode.java:190)
      at java.lang.Thread.run(Thread.java:619)

      Attachments

        1. secondaryExit.patch
          0.7 kB
          Dhruba Borthakur

        Activity

          People

            Unassigned Unassigned
            dhruba Dhruba Borthakur
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: