[HIVE-15848] count or sum distinct incorrect when hive.optimize.reducededuplication set to true

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.13.0
• Fix Version/s: 2.3.0
• Labels: pull-request-available
• Assignee: Zoltan Haindrich
• Reporter: Biao Wu
• Created: 08/Feb/17 08:18
• Updated: 24/Jun/20 00:27
• Resolved: 01/Mar/17 22:13

Description

Test Table:

create table test(id int,key int,name int);

Data：

id	key	name
1	1	2
1	2	3
1	3	2
1	4	2
1	5	3

Test SQL1:

select id,count(Distinct key),count(Distinct name)
from (select id,key,name from count_distinct_test group by id,key,name)m
group by id;

result：

1

5

4

expect:

1

5

2

Test SQL2:

select id,count(Distinct name),count(Distinct key)
from (select id,key,name from count_distinct_test group by id,name,key)m
group by id;

result:

1

2

5

Issue Links

• links to: GitHub Pull Request #150