Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.5, 6.0
    • Component/s: modules/spellchecker
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      This is like StopFilter, except if the token is the very last token
      and there were no non-token characters after it, it keeps the token.

      This is useful with analyzing suggesters (AnalyzingSuggester,
      AnalyzingInfixSuggester, FuzzySuggester), where you often want to
      remove stop words, but not if it's the last word and the user hasn't
      finished typing it.

      E.g. "fast a" might complete to "fast amoeba", but if you simply use
      StopFilter then the a is removed.

      Really our analysis APIs aren't quite designed to handle a "partial"
      tokens that suggesters need to work with.

        Attachments

        1. LUCENE-5165.patch
          31 kB
          Michael McCandless

          Issue Links

            Activity

              People

              • Assignee:
                mikemccand Michael McCandless
                Reporter:
                mikemccand Michael McCandless
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: