[ARROW-10313] [C++] Improve UTF8 validation speed and CSV string conversion

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 3.0.0
• Component/s: C++
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/26304
• Assignee: Antoine Pitrou
• Reporter: Antoine Pitrou
• Created: 15/Oct/20 13:05
• Updated: 11/Jan/23 08:12
• Resolved: 16/Oct/20 07:32

Description

Based on profiling from ARROW-10308, UTF8 validation is a bottleneck of CSV string conversion.

This is because we must validate many small UTF8 strings individually.

Issue Links

• relates to: ARROW-10308 [Python] read_csv from python is slow on some work loads
• links to: GitHub Pull Request #8470