Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-9735 Umbrella JIRA for Auto Scaling and Cluster Management in SolrCloud
  3. SOLR-10397

Port 'autoAddReplicas' feature to the autoscaling framework and make it work with non-shared filesystems

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 7.1, master (8.0)
    • Component/s: SolrCloud
    • Security Level: Public (Default Security Level. Issues are Public)
    • Labels:

      Description

      Currently 'autoAddReplicas=true' can be specified in the Collection Create API to automatically add replicas when a replica becomes unavailable. I propose to move this feature to the autoscaling cluster policy rules design.

      This will include the following:

      • Trigger support for ‘nodeLost’ event type
      • Modification of existing implementation of ‘autoAddReplicas’ to automatically create the appropriate ‘nodeLost’ trigger.
      • Any such auto-created trigger must be marked internally such that setting ‘autoAddReplicas=false’ via the Modify Collection API should delete or disable corresponding trigger.
      • Support for non-HDFS filesystems while retaining the optimization afforded by HDFS i.e. the replaced replica can point to the existing data dir of the old replica.
      • Deprecate/remove the feature of enabling/disabling ‘autoAddReplicas’ across the entire cluster using cluster properties in favor of using the suspend-trigger/resume-trigger APIs.

      This will retain backward compatibility for the most part and keep a common use-case easy to enable as well as make it available to more people (i.e. people who don't use HDFS).

        Attachments

        1. SOLR-10397.patch
          15 kB
          Cao Manh Dat
        2. SOLR-10397.2.patch
          77 kB
          Cao Manh Dat
        3. SOLR-10397.2.patch
          76 kB
          Cao Manh Dat
        4. SOLR-10397.2.patch
          89 kB
          Cao Manh Dat
        5. SOLR-10397.1.patch
          10 kB
          Cao Manh Dat
        6. SOLR-10397_remove_nocommit.patch
          12 kB
          Shalin Shekhar Mangar

          Issue Links

            Activity

              People

              • Assignee:
                caomanhdat Cao Manh Dat
                Reporter:
                shalinmangar Shalin Shekhar Mangar
              • Votes:
                1 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: