[LUCENE-8185] HyphenationCompoundWordTokenFilter returns terms shorter than minSubwordSize - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Open
Priority: Minor
Resolution: Unresolved
Affects Version/s: 6.6.1, 7.2.1
Fix Version/s: None
Component/s: None
Labels:
None

Lucene Fields:

New

Description

To account for languages which use binding characters ("fogemorphemes") for composing words the HyphenationCompoundWordTokenFilter re-checks the dictionary for a candidate with the last character removed when the original candidate was not found. It currently does not re-check against minSubWordSize in this case. Terms that are one character shorter than minSubWordSize can be returned.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

LUCENE-8185.patch
25/Feb/18 21:03
6 kB
Matthias Krueger

Issue Links

links to

GitHub Pull Request #326

Activity

People

Assignee:: Unassigned

Reporter:: Matthias Krueger

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 25/Feb/18 20:55

Updated:: 28/Aug/22 15:26

Time Tracking

Estimated:

Not Specified

Remaining:

Logged:

10m