[SPARK-29038] SPIP: Support Spark Materialized View

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Lantao Jin
• Created: 10/Sep/19 13:05
• Updated: 28/Jun/21 17:55

Description

Materialized view is an important approach in DBMS to cache data to accelerate queries. By creating a materialized view through SQL, the data that can be cached is very flexible, and needs to be configured arbitrarily according to specific usage scenarios. The Materialization Manager automatically updates the cache data according to changes in detail source tables, simplifying user work. When user submit query, Spark optimizer rewrites the execution plan based on the available materialized view to determine the optimal execution plan.

Details in design doc

Issue Links

• is related to: SPARK-26764 [SPIP] Spark Relational Cache
• links to: DOC: Spark Materialized View