[HIVE-19041] Thrift deserialization of Partition objects should intern fields

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.2, 3.0.0
• Fix Version/s: 2.4.0, 4.0.0-alpha-1
• Component/s: Metastore
• Assignee: Vihang Karajgaonkar
• Reporter: Vihang Karajgaonkar
• Created: 24/Mar/18 00:36
• Updated: 17/Nov/22 08:55
• Resolved: 11/May/18 18:57

Description

When a client is creating large number of partitions, the thrift objects are deserialized into Partition objects. The read method of these objects does not intern the inputformat, location, outputformat which cause large number of duplicate Strings in the HMS memory. We should intern these objects while deserialization to reduce memory pressure.