Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-3920

ngram tokenizer/filters create nonsense offsets if followed by a word combiner

          Details

          • Type: Bug
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: 3.6, 4.0-ALPHA
          • Fix Version/s: None
          • Component/s: None
          • Labels:
            None
          • Lucene Fields:
            New

            Description

            It seems like maybe its possibly applying the offsets from the wrong token?

            Because after shingling, the resulting token has a startOffset thats after the endoffset.

              Attachments

                Issue Links

                is related to

                Bug - A problem which impairs or prevents the functions of the product. LUCENE-4641 Fix analyzer bugs documented in TestRandomChains

                • Major - Major loss of function.
                • Open

                Bug - A problem which impairs or prevents the functions of the product. LUCENE-4955 NGramTokenFilter increments positions for each gram

                • Major - Major loss of function.
                • Closed
                relates to

                Bug - A problem which impairs or prevents the functions of the product. LUCENE-4955 NGramTokenFilter increments positions for each gram

                • Major - Major loss of function.
                • Closed

                Improvement - An improvement or enhancement to an existing feature or task. LUCENE-3907 Improve the Edge/NGramTokenizer/Filters

                • Major - Major loss of function.
                • Closed

                  Activity

                    People

                    • Assignee:
                      jpountz Adrien Grand
                      Reporter:
                      rcmuir Robert Muir
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      2 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: