Details
-
New Feature
-
Status: Patch Available
-
Minor
-
Resolution: Unresolved
-
None
-
None
-
New
Description
ShingleFilter is creating shingles for a single term that has been expanded by synonyms when it shouldn't. The position increment is 0.
As an example, I have an Analyzer with a SynonymFilter followed by a ShingleFilter. Assuming car and auto are synonyms, the SynonymFilter produces two tokens and position 1: car, auto. The ShingleFilter is then producing 3 tokens, when there should only be two: car, car auto, auto. This behavior seems incorrect.
Attachments
Attachments
Issue Links
- is part of
-
LUCENE-4170 TestRandomChains fail with Shingle+CommonGrams
-
- Open
-