[SPARK-35331] Attributes become unknown in RepartitionByExpression after aliased

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.8, 3.0.2, 3.1.1, 3.2.0
• Fix Version/s: 3.2.0
• Component/s: SQL
• Assignee: Kent Yao 2
• Reporter: Kent Yao 2
• Created: 07/May/21 03:47
• Updated: 08/May/21 12:01
• Resolved: 08/May/21 12:01

Description

explain extended select a b from values(1) t(a) distribute by a;
== Parsed Logical Plan ==
'RepartitionByExpression ['a]
+- 'Project ['a AS b#42]
   +- 'SubqueryAlias t
      +- 'UnresolvedInlineTable [a], [List(1)]

== Analyzed Logical Plan ==
org.apache.spark.sql.AnalysisException: cannot resolve 'a' given input columns: [b]; line 1 pos 62;
'RepartitionByExpression ['a]
+- Project [a#48 AS b#42]
   +- SubqueryAlias t
      +- LocalRelation [a#48]

Issue Links

• links to: [Github] Pull Request #32465 (yaooqinn)