[SPARK-31897] Enable codegen for GenerateExec

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.2.0
• Component/s: SQL
• Assignee: Karuppayya
• Reporter: Karuppayya
• Created: 03/Jun/20 05:08
• Updated: 19/Mar/21 03:50
• Resolved: 19/Mar/21 03:50

Description

Codegen had been disabled as part of 

https://github.com/apache/spark/commit/b5c5bd98ea5e8dbfebcf86c5459bdf765f5ceb53

There has been lots of improvements in the Generate code flow, after it had been disabled.(https://issues.apache.org/jira/browse/SPARK-21657)

Related discussion:

 http://apache-spark-developers-list.1001551.n3.nabble.com/GenerateExec-CodegenSupport-and-supportCodegen-flag-off-td22984.html

I tried enabling codegen and found query very perform with explode kind of operations.

Can we enable codegen by default for GenerateExec?

 

 

 

 

 

Issue Links

• links to: [Github] Pull Request #28715 (karuppayya)
• links to: [Github] Pull Request #28715 (karuppayya)