[HIVE-15239] hive on spark combine equivalent work get wrong result because of TS operation compare

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.2.0, 2.1.0
• Fix Version/s: 2.3.0
• Component/s: Spark
• Assignee: Rui Li
• Reporter: wangwenli
• Created: 18/Nov/16 04:17
• Updated: 21/Jul/17 18:26
• Resolved: 05/Dec/16 11:17

Description

env: hive on spark engine
reproduce step:

create table a1(KEHHAO string, START_DT string) partitioned by (END_DT string);
create table a2(KEHHAO string, START_DT string) partitioned by (END_DT string);

alter table a1 add partition(END_DT='20161020');
alter table a1 add partition(END_DT='20161021');

insert into table a1 partition(END_DT='20161020') values('2000721360','20161001');


SELECT T1.KEHHAO,COUNT(1) FROM ( 
SELECT KEHHAO FROM a1 T 
WHERE T.KEHHAO = '2000721360' AND '20161018' BETWEEN T.START_DT AND T.END_DT-1 
UNION ALL 
SELECT KEHHAO FROM a2 T
WHERE T.KEHHAO = '2000721360' AND '20161018' BETWEEN T.START_DT AND T.END_DT-1 
) T1 
GROUP BY T1.KEHHAO 
HAVING COUNT(1)>1; 

+-------------+------+--+
|  t1.kehhao  | _c1  |
+-------------+------+--+
| 2000721360  | 2    |
+-------------+------+--+

the result should be none record

Issue Links

• is related to: HIVE-15389 Backport HIVE-15239 to branch-1
• links to: RB link