[ARROW-12597] [C++] Implement OptionalParallelForAsync

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 5.0.0
• Component/s: C++
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/18644
• Assignee: David Li
• Reporter: David Li
• Created: 29/Apr/21 12:02
• Updated: 11/Jan/23 08:27
• Resolved: 15/Jun/21 15:22

Description

In ARROW-11843 we found that we still can't enable parallel column conversion for Parquet datasets because the Arrow Parquet reader uses OptionalParallelFor, which does a parallel wait. We should provide an async version to avoid nested parallelism.

Issue Links

• is duplicated by: ARROW-12916 [C++][Parquet] Always transfer to executor in Parquet AsyncGenerator
• relates to: ARROW-11843 [C++] Add asynchronous read to parquet::arrow::FileReader
• links to: GitHub Pull Request #10482