[SPARK-47238] Reduce executor memory usage by making generated code in WSCG a broadcast variable

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: SQL
• Labels: pull-request-available
• Assignee: Yan-Lin (Jared) Wang
• Reporter: Yan-Lin (Jared) Wang
• Created: 01/Mar/24 02:06
• Updated: 07/Mar/24 10:46
• Resolved: 07/Mar/24 04:55

Description

This is a stability improvement - by making the generated code during WSCG a broadcast variable to reduce memory usage per executor.

Issue Links

• links to: GitHub Pull Request #45348