[IGNITE-22470] Switch IndexMetaStorage from Vault to MetaStorage

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0-beta2
• Labels: ignite-3
• Epic Link: Catalog compaction support in indexes
• Assignee: Kirill Tkalenko
• Reporter: Kirill Tkalenko
• Reviewer: Philipp Shergalis
• Created: 11/Jun/24 15:27
• Updated: 14/Jun/24 07:37
• Resolved: 14/Jun/24 07:37

Description

After implementing IGNITE-22367, I realized that there may be a situation when we need index metadata locally, but it won’t be there. To avoid such situations and maintain consistency in the presence of index metadata while it exists in the system, we need to change the storage of index metadata from Vault to MetaStorage.

An example scenario that might reproduce the problem:

1. Node A started building an index.
2. There is no transaction load.
3. The low watermark has been updated and removed the version of the catalog in which the index appeared.
4. Node B entered the cluster and began applying changes from node A.
5. Index construction is complete.
6. The cluster has restarted.
7. Node B is experiencing a disaster recovery and needs to build the index locally.
8. The version in which the index appeared on node B is missing - there will be errors.

Issue Links

• links to: GitHub Pull Request #3917