Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5140

Too many safemode monitor threads being created in the standby namenode causing it to fail with out of memory error

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.1.0-beta
    • Fix Version/s: 2.1.1-beta
    • Component/s: ha
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      While running namenode load generator with 100 threads for 10 mins namenode was being failed over ever 2 mins.
      The standby namenode shut itself down as it ran out of memory and was not able to create another thread.
      When we searched for 'Safe mode extension entered' in the standby log it was present 55000+ times

        Attachments

        1. HDFS-5140.001.patch
          2 kB
          Jing Zhao
        2. HDFS-5140.002.patch
          3 kB
          Jing Zhao

          Activity

            People

            • Assignee:
              jingzhao Jing Zhao
              Reporter:
              arpitgupta Arpit Gupta
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: