Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Invalid
-
None
-
None
-
None
Description
With Slicing and merging operators that exposes the internals of window operators. current sliding window can be improved by eliminating duplicate aggregations or duplicate element insert into multiple panes (e.g. namespaces).
The following sliding window operation
val resultStream: DataStream = inputStream .keyBy("key") .window(SlidingEventTimeWindow.of(Time.seconds(5L), Time.seconds(15L))) .sum("value")
can produce job graph equivalent to
val resultStream: DataStream = inputStream .keyBy("key") .sliceWindow(Time.seconds(5L)) .sum("value") .slideOver(Count.of(3))