Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-2614

Enhance stateful windowing to persist the window state

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.0
    • Component/s: storm-core
    • Labels:
      None

      Description

      Right now the tuples in window are stored in memory. This limits the usage to windows that fit in memory and the source tuples cannot be acked until the window expiry. By persisting the window transparently in the state backend and caching/iterating them as need, we could support larger windows and also windowed bolts with user/application state.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                arunmahadevan Arun Mahadevan
                Reporter:
                arunmahadevan Arun Mahadevan
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 19h 40m
                  19h 40m