[HIVE-18421] Vectorized execution handles overflows in a different manner than non-vectorized execution

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.1, 2.2.0, 2.3.2, 3.0.0
• Fix Version/s: 3.0.0
• Component/s: Vectorization
• Assignee: Vihang Karajgaonkar
• Reporter: Vihang Karajgaonkar
• Created: 10/Jan/18 03:00
• Updated: 22/May/18 23:14
• Resolved: 15/Feb/18 16:17

Description

In vectorized execution arithmetic operations which cause integer overflows can give wrong results. Issue is reproducible in both Orc and parquet.

Simple test case to reproduce this issue

set hive.vectorized.execution.enabled=true;
create table parquettable (t1 tinyint, t2 tinyint) stored as parquet;
insert into parquettable values (-104, 25), (-112, 24), (54, 9);
select t1, t2, (t1-t2) as diff from parquettable where (t1-t2) < 50 order by diff desc;
+-------+-----+-------+
|  t1   | t2  | diff  |
+-------+-----+-------+
| -104  | 25  | 127   |
| -112  | 24  | 120   |
| 54    | 9   | 45    |
+-------+-----+-------+

When vectorization is turned off the same query produces only one row.

Issue Links

• links to: RB link