[ARROW-11588] [C++] Add traceable general purpose queue(s)

• Type: Task
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Component/s: C++
• External issue URL: https://github.com/apache/arrow/issues/27458
• Assignee: Weston Pace
• Reporter: Weston Pace
• Created: 10/Feb/21 18:59
• Updated: 11/Jan/23 08:20
• Resolved: 07/Jun/21 20:30

Description

There are a few places we queue data/jobs today (e.g. readahead, thread pool).   In order to reduce complexity (single responsibility) and add traceability (so we can tell where queues are filling up)  we should create general purpose queues (e.g. the boost lockfree one) and add some basic performance counters/events (queue size, queue full, queue starved).

We will need multiple queue implementations.  Some places will need a spsc lock free queue and others will need a multi-producer / multi-consumer queue with proper waits (and potentially more queues than that).

Issue Links

• Dependent: ARROW-11590 [C++] Move CSV background generator to IO thread pool

Sub-Tasks

• [C++] Add vendored version of folly's spsc queue: Resolved