[IMPALA-7694] Add CPU resource utilization (user, system, iowait) timelines to profiles

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 3.1.0
• Fix Version/s: Impala 3.2.0
• Component/s: Backend
• Labels: observability supportability
• Epic Link: Improve Impala Profile User Experience
• Target Version: Impala 3.2.0
• Epic Color: ghx-label-4
• Assignee: Lars Volker
• Reporter: Lars Volker
• Created: 10/Oct/18 22:33
• Updated: 07/Sep/23 21:05
• Resolved: 07/Feb/19 18:56

Description

We often struggle to determine why a query was slow, in particular if it was caused by other tasks on the same machine using resources. To help with this we should include timelines for system resource utilization to the profiles. These should eventually include CPU and disk and network I/O. If it is too expensive to include these in all queries we should add a flag to add these to a percentage of queries, and a query option to force-enable them.

Issue Links

• causes: IMPALA-8173 run-workload.py KeyError on 'query_id'
• is depended upon by: IMPALA-7981 Add system disk I/O throughput to query profiles
• is depended upon by: IMPALA-7982 Add network I/O throughput to query profiles
• is depended upon by: IMPALA-12385 Enable Periodic metrics by default

Sub-Tasks

• Impala Doc: Doc CPU resource utilization (user, system, iowait) timelines in Profile: Closed