[IMPALA-6388] UnionNode sets the number of nodes incorrectly

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 2.5.0, Impala 2.6.0, Impala 2.7.0, Impala 2.8.0, Impala 2.9.0, Impala 2.10.0, Impala 2.11.0
• Fix Version/s: Impala 2.12.0
• Component/s: Frontend
• Labels: planner
• Target Version: Impala 2.12.0
• Epic Color: ghx-label-6
• Assignee: Taras Bobrovytsky
• Reporter: Alexander Behm
• Created: 11/Jan/18 21:01
• Updated: 23/Jan/18 00:39
• Resolved: 17/Jan/18 02:02

Description

The UnionNode plan node incorrectly sets the number of nodes based on its first child. An inaccurate number of nodes can lead to bad planning decisions, e.g. wrong join order or strategy.

A better policy would be to set the number of nodes based on the max nodes over all the union's children. That number might still underestimate the real number of nodes, but significantly less so.

Getting a more accurate estimate would involve keeping track of the actual list of hosts in all plan nodes. Let's focus on the simpler solution outlined above first.