[SPARK-17915] Prepare ColumnVector implementation for UnsafeData

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 2.0.0, 2.0.1
• Component/s: SQL
• Target Version/s: 2.4.0
• Assignee: Unassigned
• Reporter: Kazuaki Ishizaki
• Created: 13/Oct/16 17:59
• Updated: 11/Sep/18 14:21
• Resolved: 11/Sep/18 14:21

Description

Current implementations of ColumnarVector are OnHeapColumnarVector and OffHeapColumnarVector, which are optimized for reading data from Parquet. If they get an array, an map, or an struct from a Unsafe related data structure, it is inefficient.
This JIRA prepares a new implementation OnHeapUnsafeColumnarVector that is optimized for reading data from a Unsafe related data structure.

Issue Links

• links to: [Github] Pull Request #15468 (kiszk)