[DRILL-8063] OOM planning a certain query

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.19.0
• Component/s: Query Planning & Optimization
• Assignee: Vova Vysotskyi
• Reporter: James Turton
• Created: 01/Dec/21 13:01
• Updated: 07/Aug/22 18:45
• Resolved: 07/Aug/22 18:45

Description

This looks like an infinite planning bug in Calcite.  To reproduce, copy the two referenced TPCH Parquet files from contrib/data/tpch-sample-data/parquet/ to dfs.tmp then run the following. Uncommenting the `magic_fix` column is just one of the changes that can be made to make the query planning succeed.

 

select
    p_brand,
--     'foobar' as magic_fix,
    case
        when f1 then v1
        else null
    end as `m_1`,
    case
        when f1 then v2
        else null
    end as `m_2`
from
    (select
         part.`p_brand`,
  		 sum(t.l_extendedprice) as v1,
   		 avg(t.l_extendedprice) as v2,
         true as f1
     from
          dfs.tmp.`lineitem.parquet` `t`
     inner join dfs.tmp.`part.parquet` part on `t`.`l_partkey` = part.`p_partkey`
     group by part.`p_brand`) as `t2`; 

 

 

Stack trace snippet:

 

2021-12-01 13:12:15,172 [1e58a77f-0a5d-22b5-47f6-4c51bc31dbe6:foreman] ERROR o.a.drill.common.CatastrophicFailure - Cat
astrophic Failure Occurred, exiting. Information message: Unable to handle out of memory condition in Foreman.
java.lang.OutOfMemoryError: Java heap space
at java.base/java.util.Arrays.copyOf(Arrays.java:3745)
at java.base/java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:172)
at java.base/java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:538)
at java.base/java.lang.StringBuilder.append(StringBuilder.java:174)
at java.base/java.lang.StringBuilder.append(StringBuilder.java:168)
at org.apache.calcite.rex.RexCall.appendOperands(RexCall.java:109)
at org.apache.calcite.rex.RexCall.computeDigest(RexCall.java:166)
at org.apache.calcite.rex.RexCall.toString(RexCall.java:183)
at java.base/java.lang.String.valueOf(String.java:2951)
at java.base/java.lang.StringBuilder.append(StringBuilder.java:168)
at org.apache.calcite.rex.RexCall.appendOperands(RexCall.java:109)
at org.apache.calcite.rex.RexCall.computeDigest(RexCall.java:166)
at org.apache.calcite.rex.RexCall.toString(RexCall.java:183)
...

Issue Links

• is fixed by: DRILL-7523 Update Calcite to 1.31.0