[LUCENE-5480] Hunspell shouldnt merge dictionary entries

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.8, 6.0
• Component/s: modules/analysis
• Lucene Fields: New
• Assignee: Unassigned
• Reporter: Robert Muir
• Created: 28/Feb/14 07:11
• Updated: 28/Aug/22 14:01
• Resolved: 28/Feb/14 19:57

Description

Ive been writing lots of little unit tests for this thing, and I'm pretty positive i screwed this up in LUCENE-5468... sorry

Otherwise the whole "prefix-suffix dependencies" described in the manpage won't work.

Either 'words' should be changed from FST<Long> to FST<IntsRef>, or when there are duplicates we should add 'padding' that we just consume (suggester-style). The latter is a little tricky, but I think this is generally uncommon so it would keep the FST smaller.

shouldnt be hard to fix.