[PARQUET-2210] [C++] Skip pages based on header metadata using a callback

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: cpp-11.0.0
• Component/s: parquet-cpp
• Labels: pull-request-available
• Assignee: fatemah
• Reporter: fatemah
• Created: 31/Oct/22 16:40
• Updated: 23/Jun/24 03:32
• Resolved: 12/Jan/23 23:11

Description

Currently, we do not expose the page header metadata and they cannot be used for skipping pages. I propose exposing the metadata through a callback that would allow the caller to decide if they want to read or skip the page based on the metadata. The signature of the callback would be the following: std::function<bool(const format::PageHeader&)> skip_page_callback)

Issue Links

• is related to: ARROW-13998 [C++] Add page skipping to parquet reading
• links to: GitHub Pull Request #14603