[FLINK-10132] Incremental cleanup of local expired state with TTL discovered in full snapshot

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 1.7.0
• Component/s: Runtime / State Backends
• Labels: pull-request-available
• Assignee: Andrey Zagrebin
• Reporter: Andrey Zagrebin
• Created: 13/Aug/18 14:30
• Updated: 23/Mar/19 16:53
• Resolved: 23/Mar/19 16:53

Description

This issue suggests to extend approach from FLINK-9938 and add a queue between a snapshotting thread which discovers expired state during its full scan and main thread which accesses state and can incrementally pull the queue and clean up local state if still applicable.

Issue Links

• relates to: FLINK-9510 State TTL API with cleanup on explicit access
• relates to: FLINK-9938 State TTL cleanup of full state snapshot upon checkpointing
• links to: GitHub Pull Request #6548