[IMPALA-12005] Explain executor group set selection criteria in query profile

• Type: Improvement
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 4.2.0
• Fix Version/s: Impala 4.3.0
• Component/s: Frontend
• Target Version: Impala 4.3.0
• Epic Color: ghx-label-11
• Assignee: Riza Suminto
• Reporter: Riza Suminto
• Created: 15/Mar/23 19:57
• Updated: 23/Mar/23 16:20
• Resolved: 23/Mar/23 15:33

Description

IMPALA-10992 and IMPALA-11604  adds memory and cpu constraint criteria for executor group set selection. We should explain this selection criteria in query profile. Things that we should consider adding to query profile:

• The effective degree of parallelism (EDoP) value that was used to calculate fitness for a given group. Possibly some additional details about how we got to that EDoP like the per fragment values.

• Per host memory estimate for that group.
• Reason for not choosing a given group (if any) - was it based on memory or CPU, what thresholds were we comparing to, etc.

In the event of none executor group set is fit, the returned AnalysisException also need to provide more context. Right now, only these are returned:

AnalysisException: The query does not fit any executor group sets.