[CALCITE-3244] RelDecorrelator unable to decorrelate expression with filter and aggregate on top

• Type: Improvement
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.20.0
• Labels: pull-request-available
• Assignee: Danny Chen
• Reporter: benj
• Created: 12/Aug/19 15:09
• Updated: 05/Sep/24 01:45

Description

Some very useful type of requests currently failed with:

SYSTEM ERROR: UnsupportedOperationException: Adding Implicit RowID column is not supported for ValuesPrel operator 

Examples from DRILL-7050:

select t1.id,
     (select count(t2.id) 
     from (
         select 1 as id 
         union all 
         select 2 as id
     ) t2 where t2.id = t1.id)
 from (
     select 1 as id 
     union all 
     select 2 as id
 ) t1

SELECT t,
(SELECT count(*) FROM
 (SELECT split(r,' ') AS r FROM
  (SELECT sub.t AS r)) AS x
 ,LATERAL(SELECT $unnest AS u FROM unnest(x.r))
 /* WHERE ... */) t2
FROM
(SELECT 'unnest is useful' AS t) sub

 

Please note that in 1.18 the error for these requests was:

Error: PLAN ERROR: Cannot convert RexNode to equivalent Drill expression. RexNode Class: org.apache.calcite.rex.RexCorrelVariable, RexNode Digest: $cor0

Issue Links

• is related to: CALCITE-6559 Query with measure that applies AVG to SMALLINT throws AssertionError "Cannot add expression of different type to set"
• links to: GitHub Pull Request #1417