Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-2901

KeywordMarkerFilter resets keyword attribute state to false for tokens not in protwords.txt

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 3.1
    • 3.1, 4.0-ALPHA
    • modules/analysis
    • None
    • New

    Description

      KeywordMarkerFilter sets true or false for the KeywordAttribute on all tokens. This erases previous state established further up the filter chain, for example in the case where a custom filter wants to prevent a token from being stemmed.

      If a token is already marked as a keyword (KeywordAttribute.isKeyword() == true), perhaps the KeywordMarkerFilterFactory should not re-set the state to false.

      Attachments

        1. LUCENE-2901.patch
          0.8 kB
          Drew Farris
        2. LUCENE-2901.patch
          0.8 kB
          Drew Farris

        Activity

          People

            rcmuir Robert Muir
            drew.farris Drew Farris
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment