[SOLR-14665] Collection creation is progressively slower

• Type: Improvement
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 8.6.1, 8.7
• Assignee: Andrzej Bialecki
• Reporter: Ishan Chattopadhyaya
• Created: 18/Jul/20 02:44
• Updated: 19/Aug/20 21:26
• Resolved: 30/Jul/20 20:56

Description

Plain and simple collection creation (or even shard splits etc.) get progressively slower as more and more collections are in the system. The culprit is the autoscaling framework (possibly some unnecessary policy computation), even when no autoscaling is being used whatsoever.

 

Here is how bad the situation is:

https://issues.apache.org/jira/browse/SOLR-14656?focusedCommentId=17160311&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17160311

 

 

Btw, even when using createnodeset parameter, there is still a gradual slowdown (but less steep than the graph here).

 

This is a matter of grave concern for anyone running a Solr cluster with more than a few hundred collections.

Issue Links

• is caused by: SOLR-12739 Make autoscaling policy based replica placement the default strategy for placing replicas
• is caused by: SOLR-12845 Add a default cluster policy