[LUCENE-3508] Decompounders based on CompoundWordTokenFilterBase cannot be used with custom attributes

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4, 4.0-ALPHA
• Fix Version/s: 3.5, 4.0-ALPHA
• Component/s: modules/analysis
• Lucene Fields: Patch Available
• Assignee: Uwe Schindler
• Reporter: Spyros Kapnissis
• Created: 11/Oct/11 16:03
• Updated: 28/Aug/22 12:59
• Resolved: 25/Oct/11 11:30

Description

The CompoundWordTokenFilterBase.setToken method will call clearAttributes() and then will reset only the default Token attributes (term, position, flags, etc) resulting in any custom attributes losing their value. Commenting out clearAttributes() seems to do the trick, but will fail the TestCompoundWordTokenFilter tests..

Sub-Tasks

• Remove deprecated methods in CompoundTokenFilters: Closed