[IGNITE-13805] Add support for cache group restore from a snapshot on the same topology

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.11
• Labels: iep-43 important ise
• Release Note: Added the ability to restore cache groups from a snapshot on an active cluster by using the Java API or command line control script.
• Ignite Flags: Docs Required, Release Notes Required
• Assignee: Pavel Pereslegin
• Reporter: Pavel Pereslegin
• Created: 02/Dec/20 16:09
• Updated: 12/Sep/22 16:50
• Resolved: 14/May/21 17:15

Description

Ignite 2.9 introduces a new feature to take consistent cluster snapshot.

However, there is currently no way for the user to restore a separate cache group from such a snapshot.

As a first step, we must provide the ability (CLI command and public API) to restore the separate cache group(s) without considering the current partition distribution and rely on rebalancing to achieve the ideal distribution.

This process consists of the following steps:

1. Make sure that all partitions of the cache group are available in the cluster and that there are no conflicts in the saved cache configurations.
2. Make sure the target cache group does not exist (user must manually destroy the cache before restoring)..
3. Move the cache data files locally on each node with the cache data snapshots.
4. Merge the binary metadata from the snapshot on each node.
5. Dynamically start the restored cache group.

Issue Links

• causes: IGNITE-15170 Automatic snapshot restore operation fails if node consistent ID is not defined
• is related to: IGNITE-14070 Implement API for custom snapshot lifecycle handlers (extensions).
• is related to: IGNITE-14723 Add CLI command to restore a cache group from the snapshot.
• is related to: IGNITE-14794 Add JMX command and metrics for automatic snapshot restore operation.
• is related to: IGNITE-14933 Implement metrics for a snapshot restore operation
• is related to: IGNITE-14722 Document the ability to automatically restore a cache group from the snapshot.
• requires: IGNITE-14352 Add the ability to check the consistency of individual cache groups in a snapshot.
• links to: Design description
• links to: GitHub Pull Request #8648
• links to: TC run all