[SPARK-41669] Speed up CollapseProject for wide tables

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: SQL
• Assignee: Allison Wang
• Reporter: Allison Wang
• Created: 21/Dec/22 20:24
• Updated: 22/Dec/22 02:09
• Resolved: 22/Dec/22 02:09

Description

Currently, CollapseProject can be very slow when the project list contains a large number of expressions. We can speed this up by doing early pruning in `canCollapseExpressions`.

Issue Links

• links to: [Github] Pull Request #39161 (allisonwang-db)