[IMPALA-11740] Incorrect results for partitioned Iceberg V2 tables when runtime filters are applied

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.2.0
• Labels: impala-iceberg
• Target Version: Impala 4.2.0
• Epic Color: ghx-label-5
• Assignee: Zoltán Borók-Nagy
• Reporter: Zoltán Borók-Nagy
• Created: 23/Nov/22 16:02
• Updated: 01/Dec/22 09:54
• Resolved: 01/Dec/22 09:54

Description

If an Iceberg V2 table is partitioned, and contains delete files, then in a query that involves runtime filters on the partition columns return empty result set.

select count(*) from store_sales, date_dim where d_date_sk = ss_sold_date_sk and d_moy=2 and d_year=1998;

In the above query store_sales is partitioned by ss_sold_date_sk which will be filtered by runtime filters created by the JOIN. If store_sales has delete files then the above query returns empty result set.