Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
0.16.0
-
None
-
None
Description
Today, the map task stops calling the map method while sort/spill is using the (single instance of) map output buffer. One improvement that can be done to improve performance of the map task is to have another buffer for writing the map outputs to, while sort/spill is using the first buffer.