[SPARK-35014] A foldable expression could not be replaced by an AttributeReference

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.3, 3.1.2, 3.2.0
• Component/s: Optimizer
• Assignee: Yingyi Bu
• Reporter: Yingyi Bu
• Created: 09/Apr/21 19:37
• Updated: 13/Apr/21 12:36
• Resolved: 13/Apr/21 12:36

Description

The PhysicalAggregation pattern can replace a foldable expression with an AttributeReference. This would subsequently fail the checkInputDataTypes() call for certain expressions, e.g., RegExpReplace – `pos` cannot be an AttributeReference.

Issue Links

• links to: [Github] Pull Request #32113 (sigmod)
• links to: [Github] Pull Request #32113 (sigmod)