Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-15138

PerReplicaStates does not scale to large collections as well as state.json

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 8.8
    • 8.9
    • SolrCloud
    • None

    Description

      I was testing PRS collection creation with larger collections today (previously I had tested with many small collections) and it seemed to be having trouble keeping up.

       

      I was running a 4 node instance, each JVM with 4G Heap in k8s, and a single zookeeper.

       

      With this cluster configuration, I am able to create several (at least 10) collections with 11 shards and 11 replicas using the "old way" of keeping state. These collections are created serially, waiting for all replicas to be active before proceeding.

      However, when attempting to do the same with PRS, the creation stalls on collection 2 or 3, with several replicas stuck in a "down" state. Further, when attempting to delete these collections using the regular API it sometimes takes several attempts after getting stuck a few times as well.

      Attachments

        Activity

          People

            noble.paul Noble Paul
            mdrob Mike Drob
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 3h 40m
                3h 40m