Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-4557

Table API Stream Aggregations

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.4.0
    • Table SQL / API
    • None

    Description

      The Table API is a declarative API to define queries on static and streaming tables. So far, only projection, selection, and union are supported operations on streaming tables.

      This issue and the corresponding FLIP proposes to add support for different types of aggregations on top of streaming tables. In particular, we seek to support:

      Group-window aggregates, i.e., aggregates which are computed for a group of elements. A (time or row-count) window is required to bound the infinite input stream into a finite group.

      Row-window aggregates, i.e., aggregates which are computed for each row, based on a window (range) of preceding and succeeding rows.
      Each type of aggregate shall be supported on keyed/grouped or non-keyed/grouped data streams for streaming tables as well as batch tables.

      Since time-windowed aggregates will be the first operation that require the definition of time, we also need to discuss how the Table API handles time characteristics, timestamps, and watermarks.

      The FLIP can be found here:
      https://cwiki.apache.org/confluence/display/FLINK/FLIP-11%3A+Table+API+Stream+Aggregations

      Attachments

        Issue Links

        1.
        Add SessionRow row-windows to Table API Sub-task Closed Timo Walther Actions
        2.
        Add TumbleRow row-windows to Table API Sub-task Closed Jark Wu Actions
        3.
        Add SlidingRow row-windows to Table API Sub-task Closed sunjincheng Actions
        4.
        Add SessionRow row-windows for batch tables. Sub-task Closed Unassigned Actions
        5.
        Add TumbleRow row-windows for batch tables. Sub-task Closed Unassigned Actions
        6.
        Add SlideRow row-windows for batch tables Sub-task Closed sunjincheng Actions
        7.
        Add group-windows for streaming tables Sub-task Closed Timo Walther Actions
        8.
        Add tumbling group-windows for batch tables Sub-task Resolved Jark Wu Actions
        9.
        Add session group-windows for batch tables Sub-task Resolved sunjincheng Actions
        10.
        Add incremental group window aggregation for streaming Table API Sub-task Closed sunjincheng Actions
        11.
        Add non-grouped session windows for batch tables Sub-task Closed sunjincheng Actions
        12.
        Refactoring Window Clause Sub-task Closed sunjincheng Actions
        13.
        Add processing time OVER ROWS BETWEEN x PRECEDING aggregation to SQL Sub-task Closed Stefano Bortoli Actions
        14.
        Add processing time OVER RANGE BETWEEN x PRECEDING aggregation to SQL Sub-task Closed radu Actions
        15.
        Add event time OVER RANGE BETWEEN x PRECEDING aggregation to SQL Sub-task Closed sunjincheng Actions
        16.
        Add processing time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to SQL Sub-task Closed sunjincheng Actions
        17.
        Add event time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to SQL Sub-task Closed hongyuhong Actions
        18.
        Optimize table type systems based on database semantics Sub-task Closed sunjincheng Actions
        19.
        Add [partitioned] processing time OVER RANGE BETWEEN UNBOUNDED PRECEDING aggregation to SQL Sub-task Closed sunjincheng Actions
        20.
        Add [non-partitioned] processing time OVER RANGE BETWEEN UNBOUNDED PRECEDING aggregation to SQL Sub-task Closed sunjincheng Actions
        21.
        Add [partitioned] event time OVER ROWS BETWEEN x PRECEDING aggregation to SQL Sub-task Closed sunjincheng Actions
        22.
        Add [non-partitioned] event time OVER ROWS BETWEEN x PRECEDING aggregation to SQL Sub-task Closed sunjincheng Actions
        23.
        Add event time OVER RANGE BETWEEN UNBOUNDED PRECEDING aggregation to SQL Sub-task Closed hongyuhong Actions
        24.
        Integrating the OVER windows in the Table API Sub-task Closed sunjincheng Actions
        25.
        Post-pass OVER windows Sub-task Closed sunjincheng Actions
        26.
        Change the alias of Window from optional to essential. Sub-task Closed sunjincheng Actions
        27.
        Update the document of group-window table API&SQL Sub-task Closed sunjincheng Actions

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            twalthr Timo Walther
            Votes:
            1 Vote for this issue
            Watchers:
            13 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment