Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-8360

NGramTokenFilter doesn't set posIncAttribute correctly in end()

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 7.4
    • Component/s: None
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      Found by randomly adding ConditionalTokenFilter to random chains, which calls end() on its delegate when it reaches a token that shouldn't have the delegate applied to it, so that things like position increments and position length are preserved.

      This is also the case for EdgeNGramTokenFilter

        Attachments

        1. LUCENE-8360.patch
          5 kB
          Alan Woodward

          Activity

            People

            • Assignee:
              romseygeek Alan Woodward
              Reporter:
              romseygeek Alan Woodward
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: