[SPARK-49819] Disable CollapseProject for correlated subqueries in projection over aggregate correctly

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0, 3.5.4
• Component/s: Optimizer
• Labels: pull-request-available
• Assignee: Nick Young
• Reporter: Nick Young
• Created: 27/Sep/24 18:12
• Updated: 30/Sep/24 12:46
• Resolved: 30/Sep/24 12:46

Description

CollapseProject should block collapsing with an aggregate if any correlated subquery is present. There are other correlated subqueries that are not ScalarSubquery that are not accounted for here.

Issue Links

• links to: GitHub Pull Request #48286