[TAJO-747] BroadCastJoin omits some data.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: 0.8.0, 0.9.0
• Fix Version/s: 0.8.0, 0.9.0
• Component/s: Planner/Optimizer
• Assignee: JaeHwa Jung
• Reporter: JaeHwa Jung
• Created: 10/Apr/14 03:12
• Updated: 21/Apr/14 07:18
• Resolved: 21/Apr/14 07:18

Description

When I tested sub-queries for TPC-DS Q32, I found a bug about BroadCastJoin as follows:

SQL

SELECT COUNT(*)
FROM (
  SELECT cs.cs_item_sk as cs_item_sk,
  cs.cs_ext_discount_amt as cs_ext_discount_amt
  FROM catalog_sales cs
  JOIN date_dim d ON (d.d_date_sk = cs.cs_sold_date_sk)
  WHERE d.d_date between '2000-01-27' and '2000-04-27'
) cs1
JOIN item i ON (i.i_item_sk = cs1.cs_item_sk);

tajo.dist-query.join.broadcast.auto = false

result: 1 rows (8 B)
?count
-------------------------------
4163848

tajo.dist-query.join.broadcast.auto = true

result: 1 rows (8 B)
?count
-------------------------------
4139958

Issue Links

• is related to: TAJO-748 Shuffle output numbers of join may be inconsistent.
• relates to: TAJO-748 Shuffle output numbers of join may be inconsistent.