Details
-
Improvement
-
Status: Open
-
P2
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Currently Flink batch needs to load all keys in memory to expire timers and call OnWindowExpiration. We could instead use the mechanism used by RequiresTimeSortedInput (https://github.com/apache/beam/blob/v2.34.0/runners/flink/src/main/java/org/apache/beam/runners/flink/FlinkBatchTransformTranslators.java#L702) to expire as we go.