[ARROW-15061] [C++] Add logging for kernel functions and exec plan nodes

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 8.0.0
• Component/s: C++
• Labels: pull-request-available query-engine
• External issue URL: https://github.com/apache/arrow/issues/30576
• Assignee: Matthijs Brobbel
• Reporter: Weston Pace
• Created: 10/Dec/21 17:03
• Updated: 11/Jan/23 08:44
• Resolved: 02/Feb/22 14:39

Description

Using OT we should add spans that report the runtime of kernel functions. We should ensure that, if OT is disabled, there is no significant overhead.

In addition we should add spans that report the runtime of each exec node. This may be a little trickier than it would first seem because pipeline breakers like join, etc. don't do all of their work inside of InputReceived. Those could potentially be added later in follow-up PRs if it is getting to be too tricky. The simple nodes like FilterNode and ProjectNode should be more straightforward. These spans should be the parent of any kernel functions launched by that node.

There should also be a span for an entire exec plan run that will be the parent of all of this.

Issue Links

• relates to: ARROW-14000 [C++] Add profiling / tracing for exec plan
• links to: GitHub Pull Request #12100
• links to: GitHub Pull Request #12694