[SPARK-18603] Support `OuterReference` in projection list of IN correlated subqueries

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.0.2
• Component/s: SQL
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Dongjoon Hyun
• Created: 27/Nov/16 23:32
• Updated: 21/May/19 04:16
• Resolved: 21/May/19 04:16

Description

This issue aims to allow OuterReference columns in projection lists of IN correlated subqueries.

SIMPLE EXAMPLE

scala> sql("CREATE TEMPORARY VIEW t1 AS SELECT * FROM VALUES 1, 2 AS t1(a)")
scala> sql("CREATE TEMPORARY VIEW t2 AS SELECT * FROM VALUES 1 AS t2(b)")
scala> sql("SELECT a FROM t1 WHERE a IN (SELECT a FROM t2)").show

COMPLEX EXAMPLE

SELECT *
FROM t1
WHERE a IN (SELECT x
            FROM (SELECT b, a + 1 as x, a + b as y
                  FROM t2)
            WHERE y > 0)