[FLINK-12697] Support on-disk state storage for spill-able heap backend

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Implemented
• Fix Version/s: 1.10.0
• Component/s: Runtime / State Backends
• Labels: pull-request-available
• Assignee: Yu Li
• Reporter: Yu Li
• Created: 31/May/19 13:28
• Updated: 15/Nov/19 10:22
• Resolved: 15/Nov/19 10:22

Description

We need to store state on disk after spilling, and to support this, we need:
1. A data structure to efficiently support copy-on-write for asynchronous snapshot
2. An allocator to allocate and manage chunks from the memory mapped file(s)

Issue Links

• blocks: FLINK-12698 Implement a SpillLoadManager
• depends upon: FLINK-12696 Implement a MmapManager
• links to: GitHub Pull Request #9501