Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Won't Fix
-
None
-
None
Description
ExternalSortExec spills intermediate data into disks when the number of tuples exceeds some threshold. This way does not consider the available memory of container, and it cannot utilize available memory well.
The objective of this issue is to improve ExternalSortExec to be aware of available memory and spill intermediate data into disks when the allocated memory is full.