[HIVE-16654] Optimize a combination of avg(), sum(), count(distinct) etc

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 3.0.0
• Assignee: Pengcheng Xiong
• Reporter: Pengcheng Xiong
• Created: 11/May/17 20:41
• Updated: 30/Jul/20 05:33
• Resolved: 01/Jun/17 01:18

Description

an example rewrite for q28 of tpcds is

(select LP as B1_LP ,CNT  as B1_CNT,CNTD as B1_CNTD
      from (select sum(xc0) / sum(xc1) as LP, sum(xc1) as CNT, count(1) as CNTD from (select sum(ss_list_price) as xc0, count(ss_list_price) as xc1 from store_sales  where 
ss_list_price is not null and ss_quantity between 0 and 5
        and (ss_list_price between 11 and 11+10 
             or ss_coupon_amt between 460 and 460+1000
             or ss_wholesale_cost between 14 and 14+20)
 group by ss_list_price) ss0) ss1) B1

Issue Links

• causes: HIVE-23954 count(*) with count(distinct) gives wrong results with hive.optimize.countdistinct=true
• links to: RB