[HIVE-7266] Optimized HashTable with vectorized map-joins results in String columns extending

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.14.0
• Fix Version/s: 0.14.0
• Component/s: Tez, Vectorization
• Assignee: Sergey Shelukhin
• Reporter: Gopal Vijayaraghavan
• Created: 20/Jun/14 17:49
• Updated: 30/Sep/15 21:31
• Resolved: 24/Jul/14 22:50

Description

The following query returns different results when both vectorized mapjoin and the new optimized hashtable are enabled.

hive> set hive.vectorized.execution.enabled=false;
hive> select s_suppkey, n_name from supplier, nation where s_nationkey = n_nationkey limit 25;
...
316869  JAPAN
1636869 RUSSIA
1096869 IRAN
7236869 RUSSIA
2276869 INDIA
8516869 ARGENTINA
2636869 MOZAMBIQUE
3836869 ROMANIA
2616869 FRANCE

But when vectorization is enabled, the results are

316869  JAPAN
1636869 RUSSIA
1096869 IRANIA
7236869 RUSSIA
2276869 INDIAA
8516869 ARGENTINA
2636869 MOZAMBIQUE
3836869 ROMANIAQUE
2616869 FRANCEAQUE

it works correctly with vectorization when the new optimized map-join hashtable is disabled

hive> set hive.vectorized.execution.enabled=true;                                             
hive> set hive.mapjoin.optimized.hashtable=false;                                             
hive> select s_suppkey, n_name from supplier, nation where s_nationkey = n_nationkey limit 25;

316869  JAPAN
1636869 RUSSIA
1096869 IRAN
7236869 RUSSIA
2276869 INDIA
8516869 ARGENTINA
2636869 MOZAMBIQUE
3836869 ROMANIA
2616869 FRANCE