Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-6460

Namenode runs of out of memory due to memory leak in ipc Server

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.20.1, 0.21.0, 0.22.0
    • Fix Version/s: 0.20.2
    • Component/s: None
    • Labels:
      None
    • Release Note:
      If an IPC server response buffer has grown to than 1MB, it is replaced by a smaller buffer to free up the Java heap that was used. This will improve the longevity of the name service.

      Description

      Namenode heap usage grows disproportional to the number objects supports (files, directories and blocks). Based on heap dump analysis, this is due to large growth in ByteArrayOutputStream allocated in o.a.h.ipc.Server.Handler.run().

        Attachments

        1. hadoop-6460.1.patch
          8 kB
          Suresh Srinivas
        2. hadoop-6460.5.patch
          2 kB
          Suresh Srinivas
        3. hadoop-6460.6.patch
          3 kB
          Suresh Srinivas
        4. hadoop-6460.7.patch
          2 kB
          Suresh Srinivas
        5. hadoop-6460.patch
          8 kB
          Suresh Srinivas
        6. hadoop-6460.rel20.patch
          2 kB
          Suresh Srinivas

          Issue Links

            Activity

              People

              • Assignee:
                sureshms Suresh Srinivas
                Reporter:
                sureshms Suresh Srinivas
              • Votes:
                0 Vote for this issue
                Watchers:
                15 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: