[ARROW-15589] [C++] Add support for sliced Substrait reads

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: C++
• Labels: substrait
• External issue URL: https://github.com/apache/arrow/issues/31053
• Assignee: Unassigned
• Reporter: Weston Pace
• Created: 05/Feb/22 02:34
• Updated: 11/Jan/23 11:38

Description

The Substrait format allows for "sliced reads" which only read a part of the file and would most likely be used if a read operation were distributed across multiple files.

For each file a start byte and length is specified. For files that contain indivisible "groups" (e.g. Parquet row groups) this is handled by picking some heuristic. For example, read all row groups whose midpoint is contained in the interval.