Details
-
Type:
New Feature
-
Status: Closed
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: None
-
Fix Version/s: 7.5
-
Component/s: None
-
Labels:None
-
Lucene Fields:New
Description
If a token consists entirely of delimiter characters, then WordDelimiterGraphFilter will remove the token and insert a hole into the TokenStream. However, it does this even if preserve_original is set, which results in an extra gap being added to the stream.