Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-11456

Improve window operator with sliding window assigners

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Invalid
    • None
    • None
    • API / DataStream
    • None

    Description

      With Slicing and merging operators that exposes the internals of window operators. current sliding window can be improved by eliminating duplicate aggregations or duplicate element insert into multiple panes (e.g. namespaces). 

      The following sliding window operation

      val resultStream: DataStream = inputStream
        .keyBy("key")
        .window(SlidingEventTimeWindow.of(Time.seconds(5L), Time.seconds(15L)))
        .sum("value")
      

      can produce job graph equivalent to

      val resultStream: DataStream = inputStream
        .keyBy("key")
        .sliceWindow(Time.seconds(5L))
        .sum("value")
        .slideOver(Count.of(3))
      

       

      Attachments

        Activity

          People

            yanghua vinoyang
            rongr Rong Rong
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: