[HIVE-18259] Automatic cleanup of invalidation cache for materialized views

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: Materialized views
• Target Version/s: 3.0.0
• Assignee: Jesús Camacho Rodríguez
• Reporter: Jesús Camacho Rodríguez
• Created: 10/Dec/17 19:04
• Updated: 27/Feb/24 22:23
• Resolved: 21/Feb/18 16:59

Description

HIVE-14498 introduces the invalidation cache for materialized views, which keeps track of the transactions executed on a given table to infer whether materialized view contents are outdated or not.

Currently, the cache keeps information of transactions in memory to guarantee quick response time, i.e., quick resolution about the view freshness, at query rewriting time. This information can grow large, thus we would like to run a thread that cleans useless transactions from the cache, i.e., transactions that do invalidate any materialized view in the system, at an interval defined by a property.

Issue Links

• contains: HIVE-18260 Add test case scenarios for materialized views invalidation cache and registry
• is blocked by: HIVE-14498 Freshness period for query rewriting using materialized views
• links to: RB link