Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-6204

Update all OVER window ProcessFunction implementations to use the SortedQueueState

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • Table SQL / API
    • None

    Description

      Currently `event time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to SQL` implementation class: ` UnboundedEventTimeOverProcessFunction` use data size uncontrollable memory data structures`sortedTimestamps: util.LinkedList [Long] cache data timestamps and sort timestamps. IMO,It's not a good way, because in the production environment there are millions of window data pre millisecond in our application scenario.So, I want to remove `util.LinkedList [Long] `. Welcome anyone to give me feedback.
      What do you think? fhueske and Yuhong_kyo

      When a SortedQueueState is available, we will Update all OVER window ProcessFunction implementations to use the SortedQueueState.

      Attachments

        Issue Links

          Activity

            People

              sunjincheng121 sunjincheng
              sunjincheng121 sunjincheng
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: