[IGNITE-23220] Avoid concurrent Catalog writes to Metastorage on the same node

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0
• Labels: ignite-3
• Assignee: Roman Puchkovskiy
• Reporter: Roman Puchkovskiy
• Reviewer: Evgeny Stanilovsky
• Created: 17/Sep/24 11:06
• Updated: 18/Sep/24 17:57
• Resolved: 17/Sep/24 14:30

Description

Each DDL tries to make a write to the Metastorage. Each write is assigned a sequential number (version); if a few DDLs try to write to the Metastorage, they will all compete for the same version, and only one of them can succeed. This competition is wasteful. We need to avoid such concurrency on the same node by explicitly linearizing writes to the Metastorage from the Catalog before doing them.

Issue Links

• causes: IGNITE-23231 [FLAKY] Exception "Send with retry timed out" while creating 1000 tables in 10 threads with replication 1
• fixes: IGNITE-22814 Exception `Max retry limit exceeded: 10` while creating 1000 tables in 10 threads with replication 1
• is related to: IGNITE-22814 Exception `Max retry limit exceeded: 10` while creating 1000 tables in 10 threads with replication 1
• links to: GitHub Pull Request #4406