[IMPALA-9156] Share broadcast join builds between fragments

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.0.0
• Component/s: Backend
• Labels: multithreading
• Epic Link: Impala Multi-threaded query execution
• Target Version: Product Backlog
• Epic Color: ghx-label-3
• Assignee: Tim Armstrong
• Reporter: Tim Armstrong
• Created: 14/Nov/19 17:40
• Updated: 07/Apr/20 15:57
• Resolved: 18/Mar/20 17:29

Description

Following on from IMPALA-4224, which should add the logic to share a single builder between multiple probe sides.

Issue Links

• breaks: IMPALA-9611 Hang in HandoffToProbesAndWait() for multithreaded join build
• depends upon: IMPALA-4224 Add backend support for join build sinks in parallel plans
• depends upon: IMPALA-9176 Make access to null-aware partition from PartitionedHashJoinNode read-only
• depends upon: IMPALA-9197 Hash table lookup should be read-only
• is depended upon by: IMPALA-9416 Reduce minimum reservation for shared broadcast join builders
• is depended upon by: IMPALA-9411 Transfer buffers from build side of shared join to avoid deep copy in NLJ
• is related to: IMPALA-4179 Remove RowBatch::MarkNeedsDeepCopy() memory management API

Sub-Tasks

• Implement phased barrier synchronisation construct: Resolved