[IGNITE-17774] Storage to provide API and features to support data rebalancing

• Type: Epic
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: persistence
• Labels: ignite-3
• Epic Name: Storage support for Rebalancing
• Assignee: Unassigned
• Reporter: Sergey Chugunov
• Created: 28/Sep/22 12:09
• Updated: 21/Feb/23 14:24

Description

Storage component should provide APIs and implementations for all types of storages (Page Memory, Rocks DB) to support rebalancing of data between nodes.

This includes several features:

1. Rebalancing preparation - consistent snapshots of stored data.
2. Effective streaming of snapshots - both on sender and receiver sides.
3. Cleaning up resources when rebalancing is completed.

Integration with indexes and SQL engine is out of scope.