Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-14275

Policy calculations are very slow for large clusters and large operations

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 7.7.2, 8.4.1
    • Fix Version/s: None
    • Component/s: AutoScaling
    • Labels:

      Description

      Replica placement calculations performed during collection creation take extremely long time (several minutes) when using a large cluster and creating a large collection (eg. 1000 nodes, 500 shards, 4 replicas).

      Profiling shows that most of the time is spent in Row.computeCacheIfAbsent, which probably doesn't reuse this cache as much as it should.

        Attachments

        1. SOLR-14275.patch
          8 kB
          Andrzej Bialecki
        2. scenario.txt
          0.5 kB
          Andrzej Bialecki

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                ab Andrzej Bialecki
              • Votes:
                1 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 50m
                  50m