[FLINK-9510] State TTL API with cleanup on explicit access

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Affects Version/s: 1.6.0
• Fix Version/s: 1.6.0
• Component/s: Runtime / State Backends
• Assignee: Andrey Zagrebin
• Reporter: Andrey Zagrebin
• Created: 04/Jun/18 07:41
• Updated: 16/Jan/20 15:40
• Resolved: 13/Aug/18 09:23

Description

This issue is about first iteration of state TTL implementation based on design doc:

https://docs.google.com/document/d/1SI_WoXAfOd4_NKpGyk4yh3mf59g12pSGNXRtNFi-tgM

Issue Links

• is depended upon by: FLINK-3089 State API Should Support Data Expiration (State TTL)
• is related to: FLINK-10095 Change the serialisation order in TTL value wrapper
• is related to: FLINK-10132 Incremental cleanup of local expired state with TTL discovered in full snapshot
• is related to: FLINK-11825 Resolve name clash of StateTTL TimeCharacteristic class
• is related to: FLINK-15605 Remove deprecated in 1.9 StateTtlConfig.TimeCharacteristic
• relates to: FLINK-9938 State TTL cleanup of full state snapshot upon checkpointing

Sub-Tasks

• Extend InternalAppendingState with internal stored state access: Closed
• Switch to internal states in StateBinder: Closed
• Create wrapper with TTL logic for value state: Closed
• Create wrapper with TTL logic for list state: Closed
• Create wrapper with TTL logic for map state: Closed
• Wrap state binder with TTL logic: Closed
• Implement TTL config: Closed
• StateDescriptor TTL config should be part of versioned meta info snapshot: Closed
• Activate TTL in state descriptors: Closed
• State TTL End-to-End Test: Closed
• Add public user documentation for TTL feature: Resolved