[LUCENE-8730] Ensure WordDelimiterGraphFilter always emits its original token first - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 8.1
Component/s: None
Labels:
None

Lucene Fields:

New

Description

WordDelimiterFilter and WordDelimiterGraphFilter behave almost identically outside setting position length; the only difference being that WDGF can sometimes emit its original token as the second output token rather than the first. We should change this to conform to the behaviour of the older filter - this will make it much easier to remove WDF entirely and cut over tests that use it incidentally.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

LUCENE-8730.patch
01/Apr/19 16:09
5 kB
Alan Woodward
LUCENE-8730.patch
18/Mar/19 13:57
4 kB
Alan Woodward

Issue Links

relates to

LUCENE-9006 Ensure WordDelimiterGraphFilter always emits catenateAll token early

Closed

Activity

People

Assignee:: Alan Woodward

Reporter:: Alan Woodward

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 18/Mar/19 13:56

Updated:: 28/Aug/22 15:43

Resolved:: 02/Apr/19 08:11