[IMPALA-9027] Update planner decisions to factor in mt_dop

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 3.4.0
• Component/s: Frontend
• Epic Color: ghx-label-5
• Assignee: Tim Armstrong
• Reporter: Tim Armstrong
• Created: 08/Oct/19 20:50
• Updated: 05/Nov/19 06:47
• Resolved: 05/Nov/19 06:47

Description

We need to make sure all decisions in the planner that currently use number of nodes use number of instances if appropriate.

E.g.

• HashJoinNode.computeNodeResourceProfile() has a TODO.
• I think the broadcast/shuffle decision doesn't take into account mt_dop, which is wrong if we're broadcasting to multiple instances per fragment.