[ARROW-10544] [C++] Provide per-processor Executors to support pinning workflows to a core

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.0.0
• Component/s: C++
• Labels: compute
• External issue URL: https://github.com/apache/arrow/issues/26510
• Assignee: Unassigned
• Reporter: Ben Kietzman
• Created: 10/Nov/20 13:57
• Updated: 11/Jan/23 08:13

Description

For many workflows, there is a distinct performance advantage to avoiding transfer of a task between processors. For example when iteratively processing a small dataset keeping everything local to a single CPU can avoid churn in split caches. Allowing each logical core to be accessible as an Executor would be one way to give developers the requisite control.