[STORM-1167] Add sliding & tumbling window support for core storm - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 1.0.0
Component/s: None
Labels:
None

Description

Currently, topologies that needs windowing support requires writing custom logic inside bolts making it tedious to handle the windowing and acking logic with custom logic.

We can add framework level support to core storm bolts to process tuples in a time or a count based window. Sliding and tumbling windows can be supported.

Later this can be extended to trident apis as well.

Attachments

Sub-Tasks

1.	State store for windowing operations	Resolved	Arun Mahadevan
2.	Checkpoint window evaluated state and use this to prune duplicate evaluations	Resolved	Arun Mahadevan
3.	Support for late and out of order events in time based windows	Resolved	Arun Mahadevan
4.	Add flux support for handling windowed bolts	Resolved	Arun Mahadevan
5.	Add documentation for windowing state store functionality	Resolved	Arun Mahadevan

Activity

People

Assignee:: Arun Mahadevan

Reporter:: Arun Mahadevan

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 04/Nov/15 11:34

Updated:: 24/Aug/17 06:08

Resolved:: 01/Jul/16 15:24