[IMPALA-3547] Bound the size of Impalad catalog cache

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: Impala 2.5.0
• Component/s: Catalog
• Labels: catalog-server usability
• Target Version: Product Backlog
• Assignee: Unassigned
• Reporter: Dimitris Tsirogiannis
• Created: 17/May/16 00:34
• Updated: 30/Jan/19 03:06
• Resolved: 30/Jan/19 03:06

Description

Currently the catalog cache of every Impalad holds a replica of the entire catalog. In certain scenarios (e.g. large metadata), the local catalog cache is using memory that could be used more effectively elsewhere. We should consider changing the impalad catalog cache into a proper cache with a configurable size limit and an invalidation mechanism.

Issue Links

• duplicates: IMPALA-7127 Fetch-on-demand metadata for the impalad-side catalog