[HADOOP-16435] RpcMetrics should not be retained forever

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 2.10.0, 3.3.0, 2.8.6, 3.2.1, 2.9.3, 3.1.3
• Component/s: rpc-server
• Hadoop Flags: Reviewed
• Assignee: Zoltan Haindrich
• Reporter: Zoltan Haindrich
• Created: 17/Jul/19 09:08
• Updated: 30/Jul/19 00:46
• Resolved: 30/Jul/19 00:46

Description

• RpcMetrics objects are registered into defaultmetricssystem
• although there is a shutdown() call (which is actually invoked) it doesn't unregisters itself from the metricssystem
• RpcDetailedMetrics has the same issue

background

• hiveserver2 slowly eats up memory when running simple queries in new sessions (select 1)
• every session opens a tezsession
• tezsession has rpcmetrics
• with a 150M heap after around 30 session the jvm gets outofmemmory

Issue Links

• is related to: HIVE-22038 Fix memory related sideeffects of opening/closing sessions