[HIVE-25546] Enable incremental rebuild of Materialized views with insert only source tables

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: CBO, Materialized views
• Labels: pull-request-available
• Target Version/s: 4.0.0
• Assignee: Krisztian Kasa
• Reporter: Krisztian Kasa
• Created: 22/Sep/21 12:22
• Updated: 05/Oct/21 03:29
• Resolved: 05/Oct/21 03:29

Description

create table t1(a int, b int, c int) stored as parquet TBLPROPERTIES ('transactional'='true', 'transactional_properties'='insert_only');

create materialized view mat1 stored as orc TBLPROPERTIES ('transactional'='true') as
select a, b, c from t1 where a > 10;

Currently materialized view mat1 can not be rebuilt incrementally because it has an insert only source table (t1). Such tables does not have ROW_ID.write_id which is required to identify newly inserted records since the last rebuild.
HIVE-25406 adds the ability to query write_id.

Issue Links

• relates to: HIVE-25406 Fetch writeId from insert-only transactional tables
• links to: GitHub Pull Request #2663