[HIVE-26497] Support materialized views on Iceberg source tables

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Materialized views
• Target Version/s: 4.0.0
• Assignee: Krisztian Kasa
• Reporter: Krisztian Kasa
• Created: 25/Aug/22 12:59
• Updated: 25/Aug/22 12:59

Description

set hive.support.concurrency=true;
set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;

create external table tbl_ice(a int, b string, c int) stored by iceberg stored as orc tblproperties ('format-version'='2');

insert into tbl_ice values (1, 'one', 50), (2, 'two', 51), (3, 'three', 52), (4, 'four', 53), (5, 'five', 54);

create materialized view mat1 as
select b, c from tbl_ice where c > 52;

Sub-Tasks

• Implement MV maintenance with Iceberg sources using full rebuild: Resolved
• Use added record count in cost model when rebuilding materialized view stored by iceberg: Resolved
• Exception when rebuilding materialized view with calculated columns on iceberg sources: Resolved
• Alter materialized view enable rewrite throws SemanticException for source iceberg table: Resolved
• Incremental materialized view throws NPE whew Iceberg source table is empty: Closed
• Support incremental materialized view rebuild when Iceberg source tables have insert operation only.: Resolved
• NPE when generating incremental rebuild plan of materialized view with empty Iceberg source table: Resolved
• Incorrect incremental rebuild mode shown of materialized view with Iceberg sources: Resolved