[SPARK-17115] Improve the performance of UnsafeProjection for wide table

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.0.1, 2.1.0
• Component/s: SQL
• Assignee: Davies Liu
• Reporter: Davies Liu
• Created: 17/Aug/16 20:11
• Updated: 22/Aug/16 08:17
• Resolved: 22/Aug/16 08:17

Description

We increase the threshold for splitting the generate code for expressions to 64K in 2.0 by accident (too optimistic), which could cause bad performance (the huge method may not be JITed), we should decrease that to 16K.

Issue Links

• links to: [Github] Pull Request #14692 (davies)