[ARROW-10620] [Rust][Parquet] move column chunk range logic to metadata.rs

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 3.0.0
• Component/s: Rust
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/18378
• Assignee: Rémi Dettai
• Reporter: Rémi Dettai
• Created: 16/Nov/20 18:15
• Updated: 11/Jan/23 08:14
• Resolved: 21/Nov/20 23:17

Description

Getting the range of bytes of a column chunk inside a parquet file can be useful for external crates (for instance if they want to pre-fetch the columns), and is not completely obvious (it is enough to take a look at [1] and [2] to see that things can quickly get messy).

I think it would be nice to move this logic in the metadata definition rather than have lost it in the middle of the reader implem.

[1] https://stackoverflow.com/questions/55225108/why-is-dictionary-page-offset-0-for-plain-dictionary-encoding/
[2] https://issues.apache.org/jira/browse/PARQUET-816

Issue Links

• links to: GitHub Pull Request #8682