[HIVE-19860] HiveServer2 ObjectInspectorFactory memory leak with cachedUnionStructObjectInspector

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 3.2.0, 4.0.0-alpha-1
• Component/s: HiveServer2

Environment

hiveserver2 Interactive with LLAP.

• Assignee: Rajkumar Singh
• Reporter: Rajkumar Singh
• Created: 11/Jun/18 20:59
• Updated: 17/Nov/22 08:54
• Resolved: 03/Jul/18 19:21

Description

hiveserver2 is start seeing the memory pressure once the cachedUnionStructObjectInspector start going 

https://github.com/apache/hive/blob/master/serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/ObjectInspectorFactory.java#L345

I did not see any eviction policy for cachedUnionStructObjectInspector, so we should implement some size or time-based eviction policy. 

 

Issue Links

• relates to: HIVE-18252 Limit the size of the object inspector caches