[IMPALA-11243] Improve predicate pushdown to Iceberg

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Resolved
• Fix Version/s: Impala 4.2.0
• Component/s: Frontend
• Labels: impala-iceberg
• Epic Color: ghx-label-10
• Assignee: Li Penglin
• Reporter: Zoltán Borók-Nagy
• Created: 13/Apr/22 15:55
• Updated: 25/Oct/22 09:27
• Resolved: 08/Aug/22 10:34

Description

Iceberg provides a rich API to push down predicates, e.g. we could push down complex predicates with OR, NOT, etc.

Also, currently we only push down predicates in the form:

COL <bin-operator> LITERAL_EXPR
E.g.:
col_ts <= '2021-01-01 12:01:00'

Instead of only allowing literal expressions, we could evaluate any constant expression and push down the result to Iceberg.

Sub-Tasks

• push down IN predicate to iceberg: Resolved
• push down IS_NULL predicate to iceberg: Resolved
• push down compound predicates to iceberg: Resolved
• push down NOT_IN predicate to iceberg: Resolved