[SOLR-5475] Scale Overseer to work on multiple queues and threads

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: SolrCloud
• Assignee: Shalin Shekhar Mangar
• Reporter: Noble Paul
• Created: 20/Nov/13 14:30
• Updated: 29/Jul/17 04:00

Description

As the collections are split to multiple nodes , it is possible to separate out the events of each collection to a different queue and each queue can be serviced by a separate thread.

It works as follows

• Keep a cluster wide property collectionsPerQ
• When a collection is created it is assigned to a queue-id and that value is stored in the state of that collection. when all queues reach the max val of collectionsPerQ new queues are created
• In the OverSeer one thread is created per queue

Issue Links

• is related to: SOLR-5872 Eliminate overseer queue