[IMPALA-10599] The coordinator should avoid distributing query fragments to busy nodes.

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: Impala 3.2.0, Impala 3.4.0
• Component/s: Distributed Exec
• Labels: features
• Environment: LSB Version: core-4.1-amd64 ; Distributor ID: CentOS ; Description: CentOS release 7.4.1708.7 ; Release: 7.4.1708.7 ; impala version: 3.2.0
• Flags: Important
• Epic Color: ghx-label-4
• Assignee: Unassigned
• Reporter: Zhi Tang
• Created: 21/Mar/21 15:54
• Updated: 27/Mar/22 00:04

Description

When I join[shuffle] with unbalanced fields, there will be data-skewed nodes during execution.This will result in the skewed node being under high load for a long time, because the query is likely to be endless.If other queries are committed or running during this time, they may be rejected or an exception thrown.

Issue Links

• relates to: IMPALA-9299 Node Blacklisting: Coordinators should blacklist unhealthy nodes