Description
Because of Spark-17590 it should be relatively easy to support WITH clause in subqueries besides nested CTE definitions.
Here an example of a query that does not run on spark:
create table test (seqno int, k string, v int) using parquet;
insert into TABLE test values (1,'a', 99),(2, 'b', 88),(3, 'a', 77),(4, 'b', 66),(5, 'c', 55),(6, 'a', 44),(7, 'b', 33);
SELECT percentile(b, 0.5) FROM (WITH mavg AS (SELECT k, AVG(v) OVER (PARTITION BY k ORDER BY seqno ROWS BETWEEN 3 PRECEDING AND CURRENT ROW) as b FROM test ORDER BY seqno) SELECT k, MAX(b) as b FROM mavg GROUP BY k);
Attachments
Issue Links
- relates to
-
SPARK-17590 Analyze CTE definitions at once and allow CTE subquery to define CTE
- Resolved
- links to