Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-9735 Umbrella JIRA for Auto Scaling and Cluster Management in SolrCloud
  3. SOLR-10397

Port 'autoAddReplicas' feature to the autoscaling framework and make it work with non-shared filesystems

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 7.1, 8.0
    • SolrCloud

    Description

      Currently 'autoAddReplicas=true' can be specified in the Collection Create API to automatically add replicas when a replica becomes unavailable. I propose to move this feature to the autoscaling cluster policy rules design.

      This will include the following:

      • Trigger support for ‘nodeLost’ event type
      • Modification of existing implementation of ‘autoAddReplicas’ to automatically create the appropriate ‘nodeLost’ trigger.
      • Any such auto-created trigger must be marked internally such that setting ‘autoAddReplicas=false’ via the Modify Collection API should delete or disable corresponding trigger.
      • Support for non-HDFS filesystems while retaining the optimization afforded by HDFS i.e. the replaced replica can point to the existing data dir of the old replica.
      • Deprecate/remove the feature of enabling/disabling ‘autoAddReplicas’ across the entire cluster using cluster properties in favor of using the suspend-trigger/resume-trigger APIs.

      This will retain backward compatibility for the most part and keep a common use-case easy to enable as well as make it available to more people (i.e. people who don't use HDFS).

      Attachments

        1. SOLR-10397.patch
          15 kB
          Cao Manh Dat
        2. SOLR-10397.2.patch
          77 kB
          Cao Manh Dat
        3. SOLR-10397.2.patch
          76 kB
          Cao Manh Dat
        4. SOLR-10397.2.patch
          89 kB
          Cao Manh Dat
        5. SOLR-10397.1.patch
          10 kB
          Cao Manh Dat
        6. SOLR-10397_remove_nocommit.patch
          12 kB
          Shalin Shekhar Mangar

        Issue Links

          Activity

            People

              caomanhdat Cao Manh Dat
              shalin Shalin Shekhar Mangar
              Votes:
              1 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: