[CARBONDATA-2658] Fix bug in spilling in-memory pages

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 1.5.0, 1.4.1
• Component/s: data-load
• Assignee: wangsen
• Reporter: wangsen
• Due: 27/Jun/18
• Created: 26/Jun/18 12:27
• Updated: 09/Jul/18 10:04
• Resolved: 09/Jul/18 07:18

Description

User configures the carbon.load.sortMemory.spill.percentage value and performs data load for local sort and batch sort.
The data loaded is 30 million records.
User checks the memory spilled to disk for different values(20%,50%,100%) of carbon.load.sortMemory.spill.percentage in the logs.

No difference in memory spilled to disk for any value of carbon.load.sortMemory.spill.percentage 

Issue Links

• links to: GitHub Pull Request #2414