Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-4557 Table API Stream Aggregations
  3. FLINK-4937

Add incremental group window aggregation for streaming Table API

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.2.0
    • 1.2.0
    • Table SQL / API
    • None

    Description

      Group-window aggregates for streaming tables are currently not done in an incremental fashion. This means that the window collects all records and performs the aggregation when the window is closed instead of eagerly updating a partial aggregate for every added record. Since records are buffered, non-incremental aggregation requires more storage space than incremental aggregation.

      The DataStream API which is used under the hood of the streaming Table API features incremental aggregation using a ReduceFunction.

      We should add support for incremental aggregation in group-windows.

      This is a follow-up task of FLINK-4691.

      Attachments

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-5106 improving IncrementalAggregateReduceFunction

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #2792

          Activity

            People

              sunjincheng121 sunjincheng
              fhueske Fabian Hueske
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: