[FLINK-19604] FLIP-145: Support SQL windowing table-valued function

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Component/s: Table SQL / API
• Assignee: Jark Wu
• Reporter: Jark Wu
• Created: 13/Oct/20 07:59
• Updated: 18/Aug/21 10:12
• Resolved: 17/Aug/21 06:49

Description

This is an umbrella issue for FLIP-145.

FLIP-145: https://cwiki.apache.org/confluence/display/FLINK/FLIP-145%3A+Support+SQL+windowing+table-valued+function#FLIP145:SupportSQLwindowingtablevaluedfunction-CumulatingWindows

Issue Links

• relates to: FLINK-20487 Support to consume retractions for window aggregate operator
• relates to: FLINK-20611 Support 2 phase local aggregate for window aggregate operation
• relates to: FLINK-21253 Support grouping set syntax for GroupWindowAggregate
• relates to: FLINK-17767 Add offset support for TUMBLE, HOP, SESSION group windows
• mentioned in: Page Loading...

Sub-Tasks

• Implement cumulative windowing for window aggregate operator: Closed
• Implement streaming window join operator: Closed
• Implement streaming window TopN operator: Closed
• Introduce WindowProperties MetadataHandler to propagate window properties: Closed
• Support window TVF based window aggreagte in planner: Closed
• Support CUMULATE window table function in planner: Closed
• Support streaming window join in planner: Closed
• Support streaming window TopN in planner: Closed
• Introduce BytesMultiMap to support buffering records: Closed
• Allow streaming operators to use managed memory: Closed
• Refactor BytesHashMap and BytesMultiMap to support window key: Closed
• Implement mini-batch optimized slicing window aggregate operator: Closed
• Support split distinct aggregate for window TVF based aggregate: Closed
• Fix Cumulative and Hopping window should accumulate late events belonging to the cleaned slice: Closed
• Support Projection push down for Window TVF: Closed
• Support grouping set syntax for Window TVF based aggregation: Closed
• Introduce the in memory topN buffer: Closed
• Support local global optimization for window aggregation in plan: Closed
• Support local global optimization for window aggregation in runtime: Closed
• Fix bug for window join: plan is wrong if join condition contain 'IS NOT DISTINCT FROM': Closed
• Fix bug for semi/anti window join.: Closed
• Add documentation for the new window TVF based operations: Closed
• Simplify `StreamPhysicalWindowTableFunction` to a simple window assigner if successor node with `WindowAttachedWindowingStrategy` in planner: Closed
• Implement streaming window assigner tablefunction operator: Closed
• Support offset in window TVF: Closed
• Window TVF Supports session window: Closed
• Window TVF Supports session window in runtime: Closed
• Support session window agg in table runtime instead of using legacy group window agg op: Closed
• Refactor classes related to window TVF aggregation to prepare for non-aligned windows: Closed
• Support session window table function without pulling up with window agg: Closed
• Update doc about session window tvf: Closed