Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-5018

Never update offsets in CompoundWordTokenFilterBase

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.4, 6.0
    • None
    • None
    • New

    Description

      CompoundWordTokenFilterBase and its children DictionaryCompoundWordTokenFilter and HyphenationCompoundWordTokenFilter update offsets. This can make OffsetAttributeImpl trip an exception when chained with other filters that group tokens together such as ShingleFilter, see http://www.gossamer-threads.com/lists/lucene/java-dev/196376?page=last.

      Attachments

        1. LUCENE-5018.patch
          6 kB
          Adrien Grand

        Issue Links

          is part of

          Bug - A problem which impairs or prevents the functions of the product. LUCENE-4641 Fix analyzer bugs documented in TestRandomChains

          • Major - Major loss of function.
          • Open

          Activity

            People

              jpountz Adrien Grand
              jpountz Adrien Grand
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: