Description
There are several JIRAs (I'll link in a second) about trying to be more efficient about processing overseer messages as the overseer can become a bottleneck, especially with very large numbers of replicas in a cluster. One of the approaches mentioned near the end of SOLR-5872 (15-Mar) was to "read large no:of items say 10000. put them into in memory buckets and feed them into overseer....".
This JIRA is to break out that part of the discussion as it might be an easy win whereas "eliminating the Overseer queue" would be quite an undertaking.
Attachments
Attachments
Issue Links
- is a child of
-
SOLR-10265 Overseer can become the bottleneck in very large clusters
- Open
- is related to
-
SOLR-10277 On 'downnode', lots of wasteful mutations are done to ZK
- Closed
-
SOLR-5872 Eliminate overseer queue
- Open
-
SOLR-10285 Skip LEADER messages when there are leader only shards
- Closed
- relates to
-
SOLR-10641 Explore asychronous read/write for state queue/work queue read/delete
- Open
- links to