[CARBONDATA-3763] wrong insert result during insert stage command

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Assignee: Ajantha Bhat
• Reporter: Ajantha Bhat
• Created: 03/Apr/20 14:58
• Updated: 12/Oct/20 07:19
• Resolved: 12/Oct/20 07:19

Description

problem:

For insertStageCommand, spark is reusing the internalRow as two times we transform from RDD[InternalRow] -> dataframe -> logical Plan -> RDD[InternalRow]. So, same data is inserted on other rows

 

solution: Copy the internalRow after the last transform.

Issue Links

• links to: GitHub Pull Request #3694