[SPARK-23904] Big execution plan cause OOM

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.2.1
• Component/s: SQL
• Labels: SQL bulk-closed query
• Assignee: Unassigned
• Reporter: Izek Greenfield
• Created: 09/Apr/18 06:08
• Updated: 25/May/21 01:50
• Resolved: 25/May/21 01:39

Description

I create a question in StackOverflow 

Spark create the text representation of query in any case even if I don't need it.

That causes many garbage object and unneeded GC... 

 Gist with code to reproduce