Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-15138

PerReplicaStates does not scale to large collections as well as state.json

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 8.8
    • Fix Version/s: 8.9
    • Component/s: SolrCloud
    • Labels:
      None

      Description

      I was testing PRS collection creation with larger collections today (previously I had tested with many small collections) and it seemed to be having trouble keeping up.

       

      I was running a 4 node instance, each JVM with 4G Heap in k8s, and a single zookeeper.

       

      With this cluster configuration, I am able to create several (at least 10) collections with 11 shards and 11 replicas using the "old way" of keeping state. These collections are created serially, waiting for all replicas to be active before proceeding.

      However, when attempting to do the same with PRS, the creation stalls on collection 2 or 3, with several replicas stuck in a "down" state. Further, when attempting to delete these collections using the regular API it sometimes takes several attempts after getting stuck a few times as well.

        Attachments

          Activity

            People

            • Assignee:
              noble.paul Noble Paul
              Reporter:
              mdrob Mike Drob
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 3h 40m
                3h 40m