Details
-
Task
-
Status: Closed
-
Major
-
Resolution: Won't Fix
-
None
-
None
-
None
Description
There are a few places we queue data/jobs today (e.g. readahead, thread pool). In order to reduce complexity (single responsibility) and add traceability (so we can tell where queues are filling up) we should create general purpose queues (e.g. the boost lockfree one) and add some basic performance counters/events (queue size, queue full, queue starved).
We will need multiple queue implementations. Some places will need a spsc lock free queue and others will need a multi-producer / multi-consumer queue with proper waits (and potentially more queues than that).
Attachments
Issue Links
- Dependent
-
ARROW-11590 [C++] Move CSV background generator to IO thread pool
- Resolved
1.
|
[C++] Add vendored version of folly's spsc queue | Resolved | Weston Pace |
|