The new decorrelation framework is able to support subqueries with non-equality predicates. For example:
SELECT * FROM t1 WHERE c1 = (SELECT SUM(c1) FROM t2 WHERE t1.c2 > t2.c2)
The restrictions in CheckAnlysis can be removed.
- is related to
SPARK-35080 Correlated subqueries with equality predicates can return wrong results
- links to