[SPARK-47839] Fix Aggregate bug in RewriteWithExpression

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: SQL
• Labels: pull-request-available
• Assignee: Kelvin Jiang
• Reporter: Kelvin Jiang
• Created: 12/Apr/24 23:39
• Updated: 18/Apr/24 01:56
• Resolved: 18/Apr/24 01:56

Description

The following query will fail:

SELECT NULLIF(id + 1, 1)
from range(10)
group by id

This is because NullIf gets rewritten to With, then RewriteWithExpression tries to pull common expression id + 1 out of the aggregate, resulting in an invalid plan.

Issue Links

• links to: GitHub Pull Request #46034