[LUCENE-5165] Add SuggestStopFilter

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.5, 6.0
• Component/s: modules/spellchecker
• Lucene Fields: New
• Assignee: Michael McCandless
• Reporter: Michael McCandless
• Created: 10/Aug/13 18:08
• Updated: 28/Aug/22 13:51
• Resolved: 14/Aug/13 16:02

Description

This is like StopFilter, except if the token is the very last token
and there were no non-token characters after it, it keeps the token.

This is useful with analyzing suggesters (AnalyzingSuggester,
AnalyzingInfixSuggester, FuzzySuggester), where you often want to
remove stop words, but not if it's the last word and the user hasn't
finished typing it.

E.g. "fast a" might complete to "fast amoeba", but if you simply use
StopFilter then the a is removed.

Really our analysis APIs aren't quite designed to handle a "partial"
tokens that suggesters need to work with.

Issue Links

• relates to: LUCENE-5820 SuggestStopFilter should have a factory