Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-14665

Collection creation is progressively slower

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 8.6.1, 8.7
    • Component/s: None
    • Labels:
      None

      Description

      Plain and simple collection creation (or even shard splits etc.) get progressively slower as more and more collections are in the system. The culprit is the autoscaling framework (possibly some unnecessary policy computation), even when no autoscaling is being used whatsoever.

       

      Here is how bad the situation is:

      https://issues.apache.org/jira/browse/SOLR-14656?focusedCommentId=17160311&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17160311

       

       

      Btw, even when using createnodeset parameter, there is still a gradual slowdown (but less steep than the graph here).

       

      This is a matter of grave concern for anyone running a Solr cluster with more than a few hundred collections.

        Attachments

        1. Screenshot from 2020-07-18 07-49-01.png
          60 kB
          Ishan Chattopadhyaya

          Issue Links

            Activity

              People

              • Assignee:
                ab Andrzej Bialecki
                Reporter:
                ichattopadhyaya Ishan Chattopadhyaya
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: