[CARBONDATA-2807] Fixed data load performance issue with more number of records

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.1
• Assignee: Kumar Vishal
• Reporter: Kumar Vishal
• Created: 30/Jul/18 15:58
• Updated: 07/Aug/18 15:24
• Resolved: 07/Aug/18 14:38

Description

*Problem:*Data Loading is taking more time when number of records are high.
*Root cause:* As number of records are high intermediate merger is taking more time.
*Solution:* Checking the number of files present in file list is done is synchronized block because of this
each intermediate request is taking sometime and when number of records are high it impacting overall data loading performance

Issue Links

• links to: GitHub Pull Request #2588