Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
0.14.0
-
None
Description
Compile time skew join optimization clones the join operator tree and unions the results.
The problem here is that we don't properly insert the predicate for the cloned join (relying on an assert statement).
To reproduce the issue, run the simple query:
select * from tbl1 join tbl2 on tbl1.key=tbl2.key;
And suppose there's some skew in tbl1 (specify skew with CREATE or ALTER statement).
Duplicated results will be returned if you set hive.optimize.skewjoin.compiletime=true.
Attachments
Attachments
Issue Links
- is depended upon by
-
HIVE-8535 Enable compile time skew join optimization for spark [Spark Branch]
-
- Resolved
-