[HUDI-7157] Support filter pushdown for positional merging in Spark 3.5

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 1.0.0
• Epic Link: filegroup-reader-writer-completion-time
• Assignee: Lin Liu
• Reporter: Lin Liu

Reviewers

Y Ethan Guo

• Created: 28/Nov/23 22:59
• Updated: 18/Jun/24 00:27

Description

Spark 3.5 parquet reader provides a new API to return row index, which enables filter pushdown for positional merging. We should enable it for positional merging.