[HIVE-28126] Use added record count in cost model when rebuilding materialized view stored by iceberg

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.1.0
• Component/s: Iceberg integration, Materialized views
• Labels: pull-request-available
• Target Version/s: 4.1.0
• Assignee: Krisztian Kasa
• Reporter: Krisztian Kasa
• Created: 19/Mar/24 10:38
• Updated: 09/Apr/24 13:00
• Resolved: 09/Apr/24 13:00

Description

There is a cost based decision when rebuilding materialized views having aggregate.
Currently the cost model has the total count of rows of source table however incremental rebuild plan scans only the rows inserted since the last MV rebuild.

The goal is to update the row count in the cost model in case of Iceberg source tables with the sum of the added-records stored in snapshots summary since the last Mv rebuild.

Issue Links

• links to: GitHub Pull Request #5136