[FLINK-13803] Introduce SpillableHeapKeyedStateBackend and all necessities

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Runtime / State Backends
• Labels: auto-unassigned
• Assignee: Unassigned
• Reporter: Yu Li
• Created: 20/Aug/19 15:15
• Updated: 03/Jun/21 23:30

Description

This JIRA aims at introducing a new SpillableHeapKeyedStateBackend which will reuse most code of the HeapKeyedStateBackend (probably the only difference is the spill-able one will register a HybridStateTable), and allow using it in FsStateBackend and MemoryStateBackend (only as an option, by default still HeapKeyedStateBackend) through configuration.

The related necessities include but are not limited to:

• A relative backend builder class
• Relative restore operation classes
• Necessary configurations for using spill-able backend

This should be the last JIRA after which the spill-able heap backend feature will become runnable regardless of the stability and performance.