[LUCENE-5018] Never update offsets in CompoundWordTokenFilterBase - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 4.4, 6.0
Component/s: None
Labels:
None

Lucene Fields:

New

Description

CompoundWordTokenFilterBase and its children DictionaryCompoundWordTokenFilter and HyphenationCompoundWordTokenFilter update offsets. This can make OffsetAttributeImpl trip an exception when chained with other filters that group tokens together such as ShingleFilter, see http://www.gossamer-threads.com/lists/lucene/java-dev/196376?page=last.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

LUCENE-5018.patch
27/May/13 18:14
6 kB
Adrien Grand

Issue Links

is part of

LUCENE-4641 Fix analyzer bugs documented in TestRandomChains

Patch Available

Activity

People

Assignee:: Adrien Grand

Reporter:: Adrien Grand

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 27/May/13 17:36

Updated:: 28/Aug/22 13:46

Resolved:: 28/May/13 07:40