Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-16435

RpcMetrics should not be retained forever

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      • RpcMetrics objects are registered into defaultmetricssystem
      • although there is a shutdown() call (which is actually invoked) it doesn't unregisters itself from the metricssystem
      • RpcDetailedMetrics has the same issue

      background

      • hiveserver2 slowly eats up memory when running simple queries in new sessions (select 1)
      • every session opens a tezsession
      • tezsession has rpcmetrics
      • with a 150M heap after around 30 session the jvm gets outofmemmory

        Attachments

        1. rpcm.hprof.xz
          18.24 MB
          Zoltan Haindrich
        2. related.jxray.png
          47 kB
          Zoltan Haindrich
        3. HADOOP-16435.01.patch
          4 kB
          Zoltan Haindrich
        4. defaultMetricsHoldsRpcMetrics.png
          9 kB
          Zoltan Haindrich
        5. classes.png
          8 kB
          Zoltan Haindrich

          Issue Links

            Activity

              People

              • Assignee:
                kgyrtkirk Zoltan Haindrich
                Reporter:
                kgyrtkirk Zoltan Haindrich
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: