Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-3946

State API Should Support Data Expiration

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • 1.0.3
    • None
    • None

    Description

      The state API should support data expiration. Consider a custom data stream operator that operates on a keyed stream and maintains a cache of items in its keyed state. The operator can expire items in the state based on event time or processing time. But as the state is keyed, if the operator is never invoked again for a previously observed key, the state associated with that key will never be expired, leading the overall job state to grow indefinitely.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              elevy Elias Levy
              Votes:
              3 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: