[CARBONDATA-2836] Fixed data loading performance issue

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.1
• Assignee: Kumar Vishal
• Reporter: Kumar Vishal
• Created: 07/Aug/18 08:33
• Updated: 07/Aug/18 11:32
• Resolved: 07/Aug/18 11:32

Description

Problem: Data Loading is taking more time when number of records are high(3.5 billion) records

Root Cause: In case of Final merge sort temp row conversion is done in main thread because of this final step processing became slower.

Solution: Mode conversion logic to pre-fetch thread for parallel processing

Issue Links

• links to: GitHub Pull Request #2611