[STORM-2614] Enhance stateful windowing to persist the window state

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: storm-core
• Assignee: Arun Mahadevan
• Reporter: Arun Mahadevan
• Created: 04/Jul/17 13:06
• Updated: 21/Aug/17 03:43
• Resolved: 08/Aug/17 02:47

Description

Right now the tuples in window are stored in memory. This limits the usage to windows that fit in memory and the source tuples cannot be acked until the window expiry. By persisting the window transparently in the state backend and caching/iterating them as need, we could support larger windows and also windowed bolts with user/application state.

Issue Links

• links to: GitHub Pull Request #2218