[ARROW-11016] [Rust] Parquet ArrayReader should allow reading a subset of row groups

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Invalid
• Component/s: Rust
• External issue URL: https://github.com/apache/arrow/issues/26935
• Assignee: Unassigned
• Reporter: Andy Grove
• Created: 23/Dec/20 16:12
• Updated: 11/Jan/23 08:17
• Resolved: 26/Apr/21 12:43

Description

Parquet ArrayReader currently only supports reading an entire file from start to finish and does not allow selectively reading a subset of row groups. This prevents us from parallelizing work across threads when processing a single parquet file.

Issue Links

• blocks: ARROW-10995 [Rust] [DataFusion] Improve parallelism when reading Parquet files
• is depended upon by: ARROW-11056 [Rust] [DataFusion] Allow ParquetExec to parallelize work based on row groups