[FLINK-32955] Support state compatibility between enabling TTL and disabling TTL

• Type: Improvement
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Component/s: Runtime / State Backends
• Assignee: xiangyu feng
• Reporter: Jinzhong Li
• Created: 25/Aug/23 04:12
• Updated: 17/Jun/24 04:02

Description

Currently, trying to restore state, which was previously configured without TTL, using TTL enabled descriptor or vice versa will lead to compatibility failure and StateMigrationException.

In some scenario, user may enable state ttl and restore from old state which was previously configured without TTL;  or vice versa.

It would be useful for users if we support state compatibility between enabling TTL and disabling TTL.

Sub-Tasks

• Support state migration between disabling and enabling ttl in RocksDBKeyedStateBackend: In Progress
• Introduce TtlAwareSerializer to resolve the compatibility check between ttlSerializer and original serializer: Resolved