[SOLR-12914] Solr crashes in /terms request handler

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 7.5
• Labels: terms
• Assignee: Unassigned
• Reporter: Vadim Miller
• Created: 24/Oct/18 16:05
• Updated: 08/Jun/19 15:02
• Resolved: 29/Apr/19 15:54

Description

TermsComponent class always tries to fetch all terms from all shards for a further processing. There is  java.lang.OutOfMemoryError  exception if the resulting list is too long. Solr stops working on this shard after this exception, only restart helps. 

There is a very common use case when the full terms list is not required: a client needs to see next N terms in alphabetically sorted list starting with a given value. Usually, this is needed for some autocomplete field on a page.

Example URL: 
http://localhost:8983/solr/mycollection/terms?terms.fl=fulltext&terms.sort=index&terms.lower=cat&terms.limit=50
 
In this example TermsComponent needs to fetch only 50 terms from each shard starting with a value provided in terms.lower URL parameter. So, it should not reset TermsParams.TERMS_LIMIT parameter when generates a shard query in createSmartShardQuery() method.

The patch is attached.

Issue Links

• is duplicated by: SOLR-13337 TermsComponent sharded and terms.sort=index performance