Details
-
New Feature
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
Description
In some usecases (webanalytics) there is a need to have a state per visitor on a website (i.e. keyBy(sessionid) ).
At some point the visitor simply leaves and no longer creates new events (so a special 'end of session' event will not occur).
The only way to determine that a visitor has left is by choosing a timeout, like "After 30 minutes no events we consider the visitor 'gone'".
Only after this (chosen) timeout has expired should we discard this state.
In the Trigger part of Windows we can set a timer and close/discard this kind of information. But that introduces the buffering effect of the window (which in some scenarios is unwanted).
What I would like is to be able to set a timeout on a specific state which I can update afterwards.
This makes it possible to create a map function that assigns the right value and that discards the state automatically.
Attachments
Issue Links
- depends upon
-
FLINK-12005 [State TTL] Event time support
- Open
-
FLINK-9510 State TTL API with cleanup on explicit access
- Closed
-
FLINK-10471 State TTL cleanup using RocksDb compaction filter
- Closed
-
FLINK-10473 State TTL incremental cleanup using Heap backend key iterator
- Closed
-
FLINK-9938 State TTL cleanup of full state snapshot upon checkpointing
- Resolved
-
FLINK-12476 [State TTL] Consider setting a default background cleanup strategy in StateTtlConfig
- Closed
-
FLINK-14898 Enable background cleanup of state with TTL by default
- Closed
- is depended upon by
-
FLINK-4428 Method map/flatMapWithState may need a eviction policy
- Closed
- is duplicated by
-
FLINK-3946 State API Should Support Data Expiration
- Closed
- is related to
-
FLINK-16686 [State TTL] Make user class loader available in native RocksDB compaction thread
- Open
-
FLINK-18467 Document what can be reconfigured for state with TTL between job restarts
- Open
-
FLINK-15606 Deprecate enable default background cleanup of state with TTL
- Closed
- mentioned in
-
Page Loading...