Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-11285

Support simulations at scale in the autoscaling framework

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 7.3, 8.0
    • Component/s: AutoScaling
    • Labels:
      None

      Description

      This is a spike to investigate how difficult it would be to modify the autoscaling framework so that it's possible to run simulated large-scale experiments and test its dynamic behavior without actually spinning up a large cluster.
      Currently many components rely heavily on actual Solr, ZK and behavior of ZK watches, or insist on making actual HTTP calls. Notable exception is the core Policy framework where most of the ZK / Solr details are abstracted.
      As the algorithms for autoscaling that we implement become more and more complex the ability to effectively run multiple large simulations will be crucial - it's very easy to unknowingly introduce catastrophic instabilities that don't manifest themselves in regular unit tests.

        Attachments

        1. SOLR-11285.patch
          156 kB
          Andrzej Bialecki

          Issue Links

            Activity

              People

              • Assignee:
                ab Andrzej Bialecki
                Reporter:
                ab Andrzej Bialecki
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: