[IMPALA-6876] Entries in CatalogUsageMonitor are not cleared after invalidation

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 3.0, Impala 2.12.0
• Fix Version/s: Impala 4.3.0
• Component/s: Catalog
• Labels: memory-leak ramp-up
• Target Version: Impala 4.3.0
• Epic Color: ghx-label-1
• Assignee: XiangYang
• Reporter: Dimitris Tsirogiannis
• Created: 18/Apr/18 20:36
• Updated: 03/Jul/23 02:54
• Resolved: 03/Jul/23 02:54

Description

The CatalogUsageMonitor in the catalog maintains a small cache of references to tables that: a) are accessed frequently in the catalog and b) have the highest memory requirements. These entries are not cleared upon server or table invalidation, thus preventing the GC from collecting the memory of these tables. We should make sure that the CatalogUsageMonitor does not maintain entries of tables that have been invalidated or deleted.