[DRILL-4121] External Sort may not spill if above a receiver

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 1.5.0
• Assignee: Kunal Khatua
• Reporter: Abdel Hakim Deneche
• Reviewer: Kunal Khatua
• Created: 23/Nov/15 17:07
• Updated: 22/Jun/16 23:42
• Resolved: 08/Jan/16 22:05

Description

If external sort is above a receiver, all received batches will contain non root buffers. Sort operator doesn't account for non root buffers when estimating how much memory and if it needs to spill to disk. This may delay the spill and cause the corresponding Drillbit to use large amounts of memory