Details
-
Improvement
-
Status: Resolved
-
Critical
-
Resolution: Fixed
-
1.12.0
Description
External Sort has boot time configuration for output batch size "drill.exec.sort.external.spill.merge_batch_size" which is defaulted to 16M.
To make batch sizing configuration uniform across all operators, change this to use new system option that is added "drill.exec.memory.operator.output_batch_size". This option has default value of 32M.
So, what are the implications if default is changed to 32M for external sort ?
Instead, should we change the output batch size default to 16M for all operators ?
Attachments
Issue Links
- relates to
-
DRILL-6238 Batch sizing for operators
-
- Open
-
- links to