[IMPALA-9229] Link failed and retried runtime profiles

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: Impala 4.0.0
• Epic Color: ghx-label-12
• Assignee: Sahil Takiar
• Reporter: Sahil Takiar
• Created: 10/Dec/19 16:01
• Updated: 19/Sep/20 00:35
• Resolved: 19/Sep/20 00:35

Description

There should be a way for clients to link the runtime profiles from failed queries to all retry attempts (whether successful or not), and vice versa.

There are a few ways to do this:

• The simplest way would be to include the query id of the retried query in the runtime profile of the failed query, and vice versa; users could then manually create a chain of runtime profiles in order to fetch all failed / successful attempts
• Extend TGetRuntimeProfileReq to include an option to fetch all runtime profiles for the given query id + all retry attempts (or add a new Thrift call TGetRetryQueryIds(TQueryId) which returns a list of retried ids for a given query id)
• The Impala debug UI should include a simple way to view all the runtime profiles of a query (the failed attempts + all retry attempts) side by side (perhaps the query_profile?query_id profile should include tabs to easily switch between the runtime profiles of each attempt)

These are not mutually exclusive, and it might be good to stage these changes.

Issue Links

• is related to: IMPALA-9870 summary and profile command in impala-shell should show both original and retried info