[IMPALA-6741] Profiles of running queries should tell last update time of counters

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 3.2.0
• Component/s: Backend
• Labels: ramp-up supportability
• Epic Link: SupportabilityRoadMap
• Epic Color: ghx-label-2
• Assignee: Michael Ho
• Reporter: Balazs Jeszenszky
• Created: 26/Mar/18 18:45
• Updated: 04/Dec/18 02:07
• Resolved: 04/Dec/18 02:07

Description

When looking at the profile of a running query, it's impossible to tell the degree of accuracy. We've seen issues both with instances not checking in with the coordinator for a long time, and with hung instances that never update their counters. There are some specific issues as well, see IMPALA-5200. This means that profiles taken off of running queries can't be used perf troubleshooting with confidence.

Ideally, Impala should guarantee counters to be written at a certain interval, and warn for counters or instances that are out of sync for some reason.

Issue Links

• is related to: IMPALA-7724 Improve Impala Profile User Experience
• is related to: IMPALA-7232 Display whether fragment instances' profile is complete