[SOLR-11595] optimize SolrIndexSearcher.localCollectionStatistics to use cached MultiFields

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 7.2
• Component/s: search
• Assignee: David Smiley
• Reporter: David Smiley
• Created: 01/Nov/17 20:06
• Updated: 08/Jun/19 15:11
• Resolved: 14/Nov/17 22:08

Description

SolrIndexSearcher.localCollectionStatistics(field) simply calls Lucene's IndexSearcher.collectionStatistics(field) which in turn calls MultiFields.getTerms(reader, field). Profiling in an app with many 150 fields in the query shows that building the MultiTerms here is expensive. Fortunately it turns out that Solr already has a cached instance via SlowCompositeReaderWrapper (using MultiFields which has a ConcurrentHashMap to the MultiTerms keyed by field String.

Perhaps this should be improved on the Lucene side... not sure. But here on the Solr side, the solution is straight-forward.

Issue Links

• is related to: LUCENE-8040 Optimize IndexSearcher.collectionStatistics