Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-7191

Improve stability and startup performance of SolrCloud with thousands of collections

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

      Description

      A user on the mailing list with thousands of collections (5000 on 4.10.3, 4000 on 5.0) is having severe problems with getting Solr to restart.

      I tried as hard as I could to duplicate the user setup, but I ran into many problems myself even before I was able to get 4000 collections created on a 5.0 example cloud setup. Restarting Solr takes a very long time, and it is not very stable once it's up and running.

      This kind of setup is very much pushing the envelope on SolrCloud performance and scalability. It doesn't help that I'm running both Solr nodes on one machine (I started with 'bin/solr -e cloud') and that ZK is embedded.

        Attachments

        1. lots-of-zkstatereader-updates-branch_5x.log
          384 kB
          Shawn Heisey
        2. SOLR-7191.patch
          7 kB
          Noble Paul
        3. SOLR-7191.patch
          10 kB
          Noble Paul
        4. SOLR-7191.patch
          12 kB
          Noble Paul
        5. SOLR-7191.patch
          11 kB
          Damien Kamerman
        6. SOLR-7191.patch
          3 kB
          Damien Kamerman
        7. SOLR-7191.patch
          8 kB
          Damien Kamerman
        8. SOLR-7191.patch
          3 kB
          Damien Kamerman

        Issue Links

          Activity

            People

            • Assignee:
              noble.paul Noble Paul
              Reporter:
              elyograg Shawn Heisey

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment