[ARROW-8527] [C++][CSV] Add support for ReadOptions::skip_rows >= block_size

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 5.0.0
• Component/s: C++
• Labels: csv
• External issue URL: https://github.com/apache/arrow/issues/24696
• Assignee: Nate Clark
• Reporter: Ravil Bikbulatov
• Created: 20/Apr/20 11:09
• Updated: 11/Jan/23 08:00
• Resolved: 07/Jun/21 17:24

Description

Current implementation throws error in reader.cc:286 when skip_rows > header. However, in some workloads skip_rows used for not only skipping header but for just skipping first n-rows. In this case block-size constraint is greatly interferes. I think this constraint could be removed without performance reduction.

Issue Links

• relates to: ARROW-12598 [C++][Dataset] Implement row-count for CSV or allow selecting 0 columns from CSV