[ARROW-8626] [C++] Implement "round robin" scheduler interface to fixed-size ThreadPool

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: C++
• External issue URL: https://github.com/apache/arrow/issues/24788
• Assignee: Unassigned
• Reporter: Wes McKinney
• Created: 29/Apr/20 16:04
• Updated: 11/Jan/23 08:01

Description

Currently, when submitting tasks to a thread pool, they are all commingled in a common queue. When a new task submitter shows up, they must wait in the back of the line behind all other queued tasks.

A simple alternative to this would be round-robin scheduling, where each new consumer is assigned a unique integer id, and the schedule / thread pool internally maintains the tasks associated with the consumer in separate queues.

Issue Links

• is related to: ARROW-8667 [C++] Add multi-consumer Scheduler API to sit one layer above ThreadPool
• is related to: ARROW-8765 [C++] Design Scheduler API
• is related to: ARROW-8767 [C++] Make ThreadPool task ordering configurable