[ARROW-10332] [Rust] Allow CSV reader to start from a line

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0
• Component/s: Rust
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/26320
• Assignee: Jorge Leitão
• Reporter: Jorge Leitão
• Created: 17/Oct/20 08:18
• Updated: 11/Jan/23 08:12
• Resolved: 25/Oct/20 20:23

Description

Currently, the CSV reader always start from 0 and go until the end, which makes it impossible for DataFusion to split a single file in parts, e.g. via multiple readers.

The goal of this issue is to generalize the reader to support starting from an arbitrary location (via iterating), and also have an optional upper limit.

 

Issue Links

• links to: GitHub Pull Request #8482