Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-8360

NGramTokenFilter doesn't set posIncAttribute correctly in end()

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 7.4
    • None
    • None
    • New

    Description

      Found by randomly adding ConditionalTokenFilter to random chains, which calls end() on its delegate when it reaches a token that shouldn't have the delegate applied to it, so that things like position increments and position length are preserved.

      This is also the case for EdgeNGramTokenFilter

      Attachments

        1. LUCENE-8360.patch
          5 kB
          Alan Woodward

        Activity

          People

            romseygeek Alan Woodward
            romseygeek Alan Woodward
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment