[SPARK-44233] Support an outer outer context in subquery resolution

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.5.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Takuya Ueshin
• Created: 28/Jun/23 22:09
• Updated: 28/Jun/23 22:32

Description

>>> sql("select * from range(8) t, lateral (select * from t) s")
Traceback (most recent call last):
...
pyspark.errors.exceptions.captured.AnalysisException: [TABLE_OR_VIEW_NOT_FOUND] The table or view `t` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS.; line 1 pos 49;
'Project [*]
+- 'LateralJoin lateral-subquery#0 [], Inner
   :  +- 'SubqueryAlias s
   :     +- 'Project [*]
   :        +- 'UnresolvedRelation [t], [], false
   +- SubqueryAlias t
      +- Range (0, 8, step=1, splits=None)

The subquery (select * from t) seems not looking the outer outer context and fails to resolve t.

Issue Links

• relates to: SPARK-44200 Support TABLE argument parser rule for TableValuedFunction