-
Type:
Sub-task
-
Status: Closed
-
Priority:
Major
-
Resolution: Implemented
-
Affects Version/s: None
-
Fix Version/s: None
-
Component/s: Runtime / State Backends
-
Labels:
Since we propose to use KeyGroup as the unit of spilling/loading, the first step is to store state per key-groups. Currently NestedMapsStateTable natively supports this, so we only need to refine CopyOnWriteStateTable
The main efforts required here is to extract the customized hash-map out of CopyOnWriteStateTable then use such a hash-map as the state holder for each KeyGroup. Whereafter we could extract some common logic out into StateTable.
- blocks
-
FLINK-12698 Implement a SpillLoadManager
-
- Open
-
- links to