[SPARK-19088] Optimize sequence type deserialization codegen

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.2.0
• Component/s: SQL
• Labels: performance
• Assignee: Michal Šenkýř
• Reporter: Michal Šenkýř
• Created: 05/Jan/17 18:39
• Updated: 29/Mar/17 22:01
• Resolved: 28/Mar/17 02:10

Description

Sequence type deserialization codegen added in PR #16240 should use a proper builder instead of a conversion (using to) to avoid an additional pass.

This will require an additional MapObjects-like operation that will use the provided builder instead of building an array.

Issue Links

• requires: SPARK-16792 Dataset containing a Case Class with a List type causes a CompileException (converting sequence to list)
• links to: [Github] Pull Request #16541 (michalsenkyr)
• links to: [Github] Pull Request #17473 (ueshin)