Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-16435

RpcMetrics should not be retained forever

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      • RpcMetrics objects are registered into defaultmetricssystem
      • although there is a shutdown() call (which is actually invoked) it doesn't unregisters itself from the metricssystem
      • RpcDetailedMetrics has the same issue

      background

      • hiveserver2 slowly eats up memory when running simple queries in new sessions (select 1)
      • every session opens a tezsession
      • tezsession has rpcmetrics
      • with a 150M heap after around 30 session the jvm gets outofmemmory

        Attachments

        1. classes.png
          8 kB
          Zoltan Haindrich
        2. defaultMetricsHoldsRpcMetrics.png
          9 kB
          Zoltan Haindrich
        3. HADOOP-16435.01.patch
          4 kB
          Zoltan Haindrich
        4. related.jxray.png
          47 kB
          Zoltan Haindrich
        5. rpcm.hprof.xz
          18.24 MB
          Zoltan Haindrich

        Issue Links

          Activity

            People

            • Assignee:
              kgyrtkirk Zoltan Haindrich
              Reporter:
              kgyrtkirk Zoltan Haindrich

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment