[SPARK-10585] only copy data once when generate unsafe projection

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.6.0
• Component/s: SQL
• Assignee: Wenchen Fan
• Reporter: Wenchen Fan
• Created: 14/Sep/15 05:50
• Updated: 06/Oct/15 17:04
• Resolved: 05/Oct/15 20:01

Description

When we have nested struct, array or map, we will create a byte buffer for each of them, and copy data to the buffer first, then copy them to the final row buffer. We can save the first copy and directly copy data to final row buffer.

Issue Links

• links to: [Github] Pull Request #8747 (cloud-fan)
• links to: [Github] Pull Request #8991 (cloud-fan)