Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-6460

Namenode runs of out of memory due to memory leak in ipc Server

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.20.1, 0.21.0, 0.22.0
    • Fix Version/s: 0.20.2
    • Component/s: None
    • Labels:
      None
    • Release Note:
      If an IPC server response buffer has grown to than 1MB, it is replaced by a smaller buffer to free up the Java heap that was used. This will improve the longevity of the name service.

      Description

      Namenode heap usage grows disproportional to the number objects supports (files, directories and blocks). Based on heap dump analysis, this is due to large growth in ByteArrayOutputStream allocated in o.a.h.ipc.Server.Handler.run().

        Attachments

        1. hadoop-6460.1.patch
          8 kB
          Suresh Srinivas
        2. hadoop-6460.5.patch
          2 kB
          Suresh Srinivas
        3. hadoop-6460.6.patch
          3 kB
          Suresh Srinivas
        4. hadoop-6460.7.patch
          2 kB
          Suresh Srinivas
        5. hadoop-6460.patch
          8 kB
          Suresh Srinivas
        6. hadoop-6460.rel20.patch
          2 kB
          Suresh Srinivas

        Issue Links

          Activity

            People

            • Assignee:
              sureshms Suresh Srinivas
              Reporter:
              sureshms Suresh Srinivas

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment