[SOLR-16879] Throttle concurrent backups/restores per node

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 9.2.1
• Fix Version/s: 9.4
• Component/s: Backup/Restore
• Assignee: Unassigned
• Reporter: Pierre Salagnac
• Created: 07/Jul/23 15:25
• Updated: 22/Apr/24 02:02
• Resolved: 31/Aug/23 20:07

Description

If the collection is large enough, there very well could be many shards on one host and it could saturate the IO. Same issue if we backup many collections concurrently.

We should have a protection mechanism, so a Solr node does not have transient failures during a large backup or restore.

Issue Links

• causes: SOLR-17149 Cannot backup/restore large collection.
• links to: GitHub Pull Request #1761
• links to: GitHub Pull Request #1864