[FLINK-12062] Introduce bundle operator to streaming table runtime

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.9.0
• Component/s: Table SQL / Runtime
• Labels: pull-request-available
• Assignee: Kurt Young
• Reporter: Kurt Young
• Created: 29/Mar/19 06:33
• Updated: 03/Apr/19 08:50
• Resolved: 03/Apr/19 08:50

Description

Bundle operator will try to save incoming records in a key-value map. Once bundler triggers, the bundle function will be invoked. All buffered data will be passed in, and one can do some optimizations based on this. 

One useful scenario for bundle operator is "Group Aggregate". We can organize the bundle data with grouping key. Once bundle triggers, we can first pre aggregate all data belongs to same key in memory, then we only have to operate with state once for each key. This will save lots of cost and have better performance.

Issue Links

• is a child of: FLINK-11489 Add an initial Blink SQL streaming runtime
• links to: GitHub Pull Request #8086