[SPARK-20474] OnHeapColumnVector realocation may not copy existing data

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 2.2.0
• Component/s: Spark Core
• Assignee: Michal Szafranski
• Reporter: Michal Szafranski
• Created: 26/Apr/17 10:25
• Updated: 26/Apr/17 19:47
• Resolved: 26/Apr/17 19:47

Description

OnHeapColumnVector reallocation copies to the new storage data up to 'elementsAppended'. This variable is only updated when using the ColumnVector.appendX API, while ColumnVector.putX is more commonly used.

Issue Links

• links to: [Github] Pull Request #17773 (michal-databricks)