Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-2674 Rework windowing logic
  3. FLINK-2676

Add abstraction for keyed window state

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • 0.10.0
    • 1.0.0
    • API / DataStream
    • None

    Description

      This abstraction should help to seamlessly switch between window state kept as

      • Heap-resident maps
      • Managed memory spillable maps
      • key/value state backend state

      I would approach this abstraction once we implemented a few window operators and see what operations we need, such as

      • Drop time-regions across all keys
      • Append to state for key
      • Update/replace state by key
      • Iterate over unions of multiple state time regions
      • snapshot time regions completely / incrementally
      • (possibly more)

      Attachments

        Activity

          People

            sewen Stephan Ewen
            sewen Stephan Ewen
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: