[ARROW-14940] [C++] Speed up CSV parser with long CSV cells

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 7.0.0
• Component/s: C++
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/30463
• Assignee: Antoine Pitrou
• Reporter: Antoine Pitrou
• Created: 01/Dec/21 13:28
• Updated: 11/Jan/23 08:43
• Resolved: 02/Dec/21 09:50

Description

Some CSV files may have long cells (values), for example if containing arbitrary texts or even things like timestamps. We can speed up parsing such CSV files by filtering multiple bytes at once for state-changing characters such as delimiters.

Issue Links

• relates to: ARROW-13923 [C++] Improve CSV chunker with SIMD
• links to: GitHub Pull Request #11828