Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
3.1.1-incubating
-
None
Description
GroupXXXStep in OLAP is able to process traversers up to the first barrier in the reduction. 99% of the time, the first barrier is the last barrier and thus, you get a nice lazy computation which limits the memory footprint.
Unfortunately, we don't have this luxury in OLAP. Until!!! However, the work that spmallette did to get GroupBiOperator to serialize with traversals might make it possible for us to merge barriers in the reduction and thus have OLAP and OLTP GroupXXXStep behave analogously.