[HIVE-21631] Enhance metastore API to allow bulk-loading materialized views

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.1, 3.2.0
• Fix Version/s: 4.0.0
• Component/s: Materialized views, Metastore
• Labels: pull-request-available
• Assignee: Jesus Camacho Rodriguez
• Reporter: Craig Condit
• Created: 18/Apr/19 16:39
• Updated: 25/Apr/19 19:48
• Resolved: 25/Apr/19 19:48

Description

Currently, every query in HS2 results in a metastore call per database to retrieve all materialized views. This causes severe performance degradation on multi-tenant clusters with thousands of databases (very similar to how the old get_function() metastore call didn't scale).

We should add a metastore call which can retrieve all materialized view definitions at once (for all DBs) so that we don't have to make thousands of metastore calls per query.

Issue Links

• relates to: HIVE-15436 Enhancing metastore APIs to retrieve only materialized views
• links to: GitHub Pull Request #606