Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-5381 Split Clusterstate and scale
  3. SOLR-5475

Scale Overseer to work on multiple queues and threads

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: SolrCloud
    • Labels:
      None

      Description

      As the collections are split to multiple nodes , it is possible to separate out the events of each collection to a different queue and each queue can be serviced by a separate thread.

      It works as follows

      • Keep a cluster wide property collectionsPerQ
      • When a collection is created it is assigned to a queue-id and that value is stored in the state of that collection. when all queues reach the max val of collectionsPerQ new queues are created
      • In the OverSeer one thread is created per queue

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                shalin Shalin Shekhar Mangar
                Reporter:
                noble.paul Noble Paul
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated: