Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Won't Fix
-
None
-
None
-
None
Description
Currently `event time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to SQL` implementation class: ` UnboundedEventTimeOverProcessFunction` use data size uncontrollable memory data structures`sortedTimestamps: util.LinkedList [Long] cache data timestamps and sort timestamps. IMO,It's not a good way, because in the production environment there are millions of window data pre millisecond in our application scenario.So, I want to remove `util.LinkedList [Long] `. Welcome anyone to give me feedback.
What do you think? fhueske and Yuhong_kyo
When a SortedQueueState is available, we will Update all OVER window ProcessFunction implementations to use the SortedQueueState.
Attachments
Issue Links
- links to