[SPARK-39783] Column backticks are misplaced in the AnalysisException [UNRESOLVED_COLUMN] error message when using field with "." - ASF JIRA

Log work

Agile Board

Rank to Top

Rank to Bottom

Attach files

Attach Screenshot

Bulk Copy Attachments

Bulk Move Attachments

Voters

Watch issue

Watchers

Create sub-task

Convert to sub-task

Move

Link

Clone

Labels

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

Delete

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: 3.4.0
Fix Version/s: 3.4.0
Component/s: SQL
Labels:
None

Description

AnalysisException [UNRESOLVED_COLUMN.WITH_SUGGESTION] shows the wrong suggestion when a field with the "." separator is referenced without backticks.

The following code references a nested value `the`.`id`, that does not exist. The proposed / existing column names are not correctly wrapped in backticks:

Seq((0)).toDF("the.id")
  .select("the.id").show()

org.apache.spark.sql.AnalysisException: [UNRESOLVED_COLUMN.WITH_SUGGESTION] A column or function parameter with name `the`.`id` cannot be resolved. Did you mean one of the following? [`the`.`id`];

Instead of suggesting [`the`.`id`] in the error message, you would expect suggesting [`the.id`].