[SPARK-46144] Fail INSERT INTO ... REPLACE statement if the condition contains subquery

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: SQL
• Labels: pull-request-available
• Assignee: Gengliang Wang
• Reporter: Gengliang Wang
• Created: 28/Nov/23 21:08
• Updated: 30/Nov/23 05:20
• Resolved: 30/Nov/23 05:20

Description

For the following query:

INSERT INTO tbl REPLACE WHERE id = (select c2 from values(1) as t(c2)) SELECT * FROM source

There will be an analysis error:

[UNRESOLVED_COLUMN.WITHOUT_SUGGESTION] A column, variable, or function parameter with name `c2` cannot be resolved.  SQLSTATE: 42703; line 1 pos 51;
'OverwriteByExpression RelationV2[id#27L, data#28] testcat.tbl testcat.tbl, (id#27L = scalar-subquery#26 []), false 

The error message is confusing. The actually reason is the OverwriteByExpression plan doesn't support subqueries. While supporting the feature is non-trivial, we should improve the error message.

Issue Links

• links to: GitHub Pull Request #44060