[IMPALA-6473] Error in analytic sort with same expr in 'partition by' and 'order by'

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 2.12.0
• Fix Version/s: Impala 3.0
• Component/s: Frontend
• Epic Color: ghx-label-4
• Assignee: Thomas Tauber-Marshall
• Reporter: Thomas Tauber-Marshall
• Created: 02/Feb/18 22:49
• Updated: 09/Feb/18 16:59
• Resolved: 06/Feb/18 21:10

Description

Repro:

drop table if exists default.tt;
CREATE TABLE default.tt (instruction_date timestamp);
SELECT sum(1) OVER( partition by to_date(instruction_date) ORDER BY to_date(instruction_date) rows UNBOUNDED PRECEDING) FROM default.tt;

Stack:

I0205 14:16:03.763309  4889 jni-util.cc:230] java.lang.IllegalStateException 
        at com.google.common.base.Preconditions.checkState(Preconditions.java:129) 
        at org.apache.impala.analysis.ExprSubstitutionMap.verify(ExprSubstitutionMap.java:162) 
        at org.apache.impala.analysis.ExprSubstitutionMap.combine(ExprSubstitutionMap.java:128) 
        at org.apache.impala.planner.AnalyticPlanner.createSortInfo(AnalyticPlanner.java:304) 
        at org.apache.impala.planner.AnalyticPlanner.createSortGroupPlan(AnalyticPlanner.java:348) 
        at org.apache.impala.planner.AnalyticPlanner.createSingleNodePlan(AnalyticPlanner.java:120) 
        at org.apache.impala.planner.SingleNodePlanner.createQueryPlan(SingleNodePlanner.java:269) 
        at org.apache.impala.planner.SingleNodePlanner.createSingleNodePlan(SingleNodePlanner.java:150) 
        at org.apache.impala.planner.Planner.createPlan(Planner.java:98) 
        at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1030) 
        at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1127) 
        at org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:156) 

The problem is caused by using the same expr in both the 'partition by' and 'order by' clauses of the analytic function.