[ARROW-15044] [C++] Add simple stdout/JSON exporter for OpenTelemetry

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 7.0.0
• Component/s: C++
• Labels: pull-request-available query-engine
• External issue URL: https://github.com/apache/arrow/issues/30561
• Assignee: David Li
• Reporter: David Li
• Created: 09/Dec/21 15:45
• Updated: 11/Jan/23 08:44
• Resolved: 16/Dec/21 18:44

Description

While it is odd for a library to configure OpenTelemetry exporters, there is a reason for this: the actual end-user is unable to configure it directly (as we use the C++ implementation, and the user is likely in Python or R), and often the "important" bits are all in C++, so it would be nice to have a way to dump the information collected.

On top of that, it would be nice to dump the data in an easily parseable format for further consumption.

We should enable the ostream exporter, as well as a custom exporter that dumps JSON. See https://github.com/open-telemetry/opentelemetry-cpp/pull/1111 for an example. See discussion on https://github.com/apache/arrow/pull/11906 as well.

Issue Links

• is depended upon by: ARROW-15059 [C++] Add basic visibility into execution engine performance
• links to: GitHub Pull Request #11925