Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-4810

Positions are incremented for each ngram in EdgeNGramTokenFilter

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.3, 6.0
    • modules/analysis
    • None
    • New

    Description

      Edge ngrams should be like synonyms, with all the ngrams generated from a token having the same position as that original token. The current code increments position.

      For the text "molecular biology", the query "mol bio" should match as a phrase in neighboring positions. It does not.

      You can see this in the Analysis page in the admin UI.

      Attachments

        1. LUCENE-4810-first-token-position-increment.patch
          4 kB
          Steven Rowe
        2. LUCENE-4810.patch
          6 kB
          Michael McCandless
        3. LUCENE-4810.patch
          4 kB
          Michael McCandless
        4. LUCENE-4810.diff
          2 kB
          Walter Underwood

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. LUCENE-3907 Improve the Edge/NGramTokenizer/Filters

          • Major - Major loss of function.
          • Closed

          Activity

            People

              mikemccand Michael McCandless
              wunder Walter Underwood
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: