Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-4557

Table API Stream Aggregations

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.4.0
    • Table SQL / API
    • None

    Description

      The Table API is a declarative API to define queries on static and streaming tables. So far, only projection, selection, and union are supported operations on streaming tables.

      This issue and the corresponding FLIP proposes to add support for different types of aggregations on top of streaming tables. In particular, we seek to support:

      Group-window aggregates, i.e., aggregates which are computed for a group of elements. A (time or row-count) window is required to bound the infinite input stream into a finite group.

      Row-window aggregates, i.e., aggregates which are computed for each row, based on a window (range) of preceding and succeeding rows.
      Each type of aggregate shall be supported on keyed/grouped or non-keyed/grouped data streams for streaming tables as well as batch tables.

      Since time-windowed aggregates will be the first operation that require the definition of time, we also need to discuss how the Table API handles time characteristics, timestamps, and watermarks.

      The FLIP can be found here:
      https://cwiki.apache.org/confluence/display/FLINK/FLIP-11%3A+Table+API+Stream+Aggregations

      Attachments

        Issue Links

          1.
          Add SessionRow row-windows to Table API Sub-task Closed Timo Walther
          2.
          Add TumbleRow row-windows to Table API Sub-task Closed Jark Wu
          3.
          Add SlidingRow row-windows to Table API Sub-task Closed sunjincheng
          4.
          Add SessionRow row-windows for batch tables. Sub-task Closed Unassigned
          5.
          Add TumbleRow row-windows for batch tables. Sub-task Closed Unassigned
          6.
          Add SlideRow row-windows for batch tables Sub-task Closed sunjincheng
          7.
          Add group-windows for streaming tables Sub-task Closed Timo Walther
          8.
          Add tumbling group-windows for batch tables Sub-task Resolved Jark Wu
          9.
          Add session group-windows for batch tables Sub-task Resolved sunjincheng
          10.
          Add incremental group window aggregation for streaming Table API Sub-task Closed sunjincheng
          11.
          Add non-grouped session windows for batch tables Sub-task Closed sunjincheng
          12.
          Refactoring Window Clause Sub-task Closed sunjincheng
          13.
          Add processing time OVER ROWS BETWEEN x PRECEDING aggregation to SQL Sub-task Closed Stefano Bortoli
          14.
          Add processing time OVER RANGE BETWEEN x PRECEDING aggregation to SQL Sub-task Closed radu
          15.
          Add event time OVER RANGE BETWEEN x PRECEDING aggregation to SQL Sub-task Closed sunjincheng
          16.
          Add processing time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to SQL Sub-task Closed sunjincheng
          17.
          Add event time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to SQL Sub-task Closed hongyuhong
          18.
          Optimize table type systems based on database semantics Sub-task Closed sunjincheng
          19.
          Add [partitioned] processing time OVER RANGE BETWEEN UNBOUNDED PRECEDING aggregation to SQL Sub-task Closed sunjincheng
          20.
          Add [non-partitioned] processing time OVER RANGE BETWEEN UNBOUNDED PRECEDING aggregation to SQL Sub-task Closed sunjincheng
          21.
          Add [partitioned] event time OVER ROWS BETWEEN x PRECEDING aggregation to SQL Sub-task Closed sunjincheng
          22.
          Add [non-partitioned] event time OVER ROWS BETWEEN x PRECEDING aggregation to SQL Sub-task Closed sunjincheng
          23.
          Add event time OVER RANGE BETWEEN UNBOUNDED PRECEDING aggregation to SQL Sub-task Closed hongyuhong
          24.
          Integrating the OVER windows in the Table API Sub-task Closed sunjincheng
          25.
          Post-pass OVER windows Sub-task Closed sunjincheng
          26.
          Change the alias of Window from optional to essential. Sub-task Closed sunjincheng
          27.
          Update the document of group-window table API&SQL Sub-task Closed sunjincheng

          Activity

            People

              Unassigned Unassigned
              twalthr Timo Walther
              Votes:
              1 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: