[SPARK-43867] Improve suggested candidates for unresolved attribute

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.5.0
• Component/s: SQL
• Assignee: Max Gekk
• Reporter: Max Gekk
• Created: 29/May/23 20:13
• Updated: 31/May/23 18:05
• Resolved: 31/May/23 18:05

Description

It is related to https://github.com/apache/spark/pull/41038 . Given a column list cols

1. group by qualifiers, if only one group, strip qualifier and only keep the column name
2. in each group,  group by the qualifiers excluding table name, if only one group, strip qualifiers excluding table name, only keep table name + column name
3. sort the result by similarity with the base string