Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Invalid
-
None
-
None
-
None
Description
In Window TVF Aggregation, currently, the AggRecordsCombiner accumulates buffered records on state directly. This is not good for performance. We can accumulate records in memory first, and then merge the accumulator into state, if the aggs support merge() method. This can reduce lots of state accessing when having COUNT DISTINCT.