Hadoop Common
  1. Hadoop Common
  2. HADOOP-6460

Namenode runs of out of memory due to memory leak in ipc Server

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.20.1, 0.21.0, 0.22.0
    • Fix Version/s: 0.20.2
    • Component/s: None
    • Labels:
      None
    • Release Note:
      If an IPC server response buffer has grown to than 1MB, it is replaced by a smaller buffer to free up the Java heap that was used. This will improve the longevity of the name service.

      Description

      Namenode heap usage grows disproportional to the number objects supports (files, directories and blocks). Based on heap dump analysis, this is due to large growth in ByteArrayOutputStream allocated in o.a.h.ipc.Server.Handler.run().

      1. hadoop-6460.rel20.patch
        2 kB
        Suresh Srinivas
      2. hadoop-6460.patch
        8 kB
        Suresh Srinivas
      3. hadoop-6460.7.patch
        2 kB
        Suresh Srinivas
      4. hadoop-6460.6.patch
        3 kB
        Suresh Srinivas
      5. hadoop-6460.5.patch
        2 kB
        Suresh Srinivas
      6. hadoop-6460.1.patch
        8 kB
        Suresh Srinivas

        Issue Links

          Activity

            People

            • Assignee:
              Suresh Srinivas
              Reporter:
              Suresh Srinivas
            • Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development