[IMPALA-12598] Add support for multiple equality field ID list

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: Frontend
• Labels: impala-iceberg
• Epic Color: ghx-label-8
• Assignee: Gabor Kaszab
• Reporter: Gabor Kaszab
• Created: 05/Dec/23 15:32
• Updated: 01/Mar/24 09:35
• Resolved: 01/Mar/24 09:35

Description

Iceberg metadata holds an equality field ID list for the equality-delete files. It's possible to have a different equality field ID list for different equality-delete files, for instance one file deletes by columnA while another file deletes by columnB.

When you have such a table you should have multiple layers of ANTI JOINs, one join for each equality field ID list.