[SOLR-14987] SolrStream ends up creating a new HttpSolrClient for every replica being queried instead of reusing for the same node

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 8.8, 9.0
• Component/s: streaming expressions
• Assignee: Timothy Potter
• Reporter: Timothy Potter
• Created: 06/Nov/20 17:38
• Updated: 12/May/22 00:26
• Resolved: 07/Dec/20 18:18

Description

Looking into some streaming expression performance issues when there are many collections with many shards being queried and I found that SolrStream's open method creates a new HttpSolrClient for every replica being queried. For instance, in my test case, I have 10 collections with 100 shards each (rf=1) and I get 1000 HttpSolrClient instances in my SolrClientCache. If I reuse HttpSolrClient's per node hosting a replica (so 10 in my case), the query time for my expression drops by half (not too mention the reduced allocation load on the JVM).

Issue Links

• links to: GitHub Pull Request #2067
• links to: GitHub Pull Request #2128