[ARROW-9344] [C++][Flight] measure latency quantile in flight benchmark

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: C++, FlightRPC
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/25428
• Assignee: Yibo Cai
• Reporter: Yibo Cai
• Created: 07/Jul/20 05:58
• Updated: 11/Jan/23 08:06
• Resolved: 31/Jul/20 15:45

Description

ARROW-9206 measures average latency in flight benchmark.
In practice, latency quantile is necessary to show the whole picture of rpc performance. E.g., 99% quantile, max, median.
A naive approach to save latencies of all batches is not applicable. Boost accumulator_set implements p square quantile algorithm which uses O(1) space with trivial computation overhead for each batch. It can be used in calculating latency quantiles.

Issue Links

• links to: GitHub Pull Request #7863