[DRILL-4236] ExternalSort should use the new allocator functionality to better manage it's memory usage

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.5.0
• Fix Version/s: 1.5.0
• Component/s: Execution - Relational Operators
• Labels: documentation
• Assignee: Kunal Khatua
• Reporter: Abdel Hakim Deneche
• Reviewer: Kunal Khatua
• Created: 30/Dec/15 19:45
• Updated: 16/Jun/16 22:57
• Resolved: 05/Jan/16 23:38

Description

Before DRILL-4215, the sort operator wasn't able to correctly compute it's memory usage, and so it jumped through a bunch of hoops to try to figure out when it should spill to disk.
With the transfer accounting in place, this code can be greatly simplified to just use the current operator memory allocation.

Issue Links

• is related to: DRILL-4243 CTAS with partition by, results in Out Of Memory