[ARROW-14444] [C++] Implement task-based model into the executable-pipelines.

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Fix Version/s: 8.0.0
• Component/s: C++
• Labels: query-engine
• External issue URL: https://github.com/apache/arrow/issues/30007
• Assignee: Unassigned
• Reporter: Alexander Ocsa
• Created: 22/Oct/21 17:41
• Updated: 11/Jan/23 08:40
• Resolved: 16/Dec/21 19:27

Description

The plan fragments will use a task-based model for parallel processing.
That means that there is a scheduler that gets assigned tasks for execution, keeps selecting the next task for execution, and assigning it to a specific executor (aka arrow thread pool).  

Issue Links

• is superceded by: ARROW-15079 [C++] Add scheduler to constrain memory of exec plans