-
Type:
Bug
-
Status: Resolved
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: 0.11.3
-
Component/s: Planner/Optimizer
-
Labels:None
Currently, one of broadcast candidates may be marked as not being broadcastable because the total volume of the merged stage exceeds the broadcast join threshold.
This is done in BroadcastJoinRule::checkTotalSizeOfBroadcastableRelations(), but it causes a bug because it doesn't split the merged stage into separate ones again.
This routine should be improved to check the total volume of broadcast candidates before merging stages.
- links to