[SOLR-17362] Hunspell dictionaries and affix loading strategy

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 9.6.1
• Component/s: Schema and Analysis
• Assignee: Unassigned
• Reporter: Guillaume Jactat
• Created: 08/Jul/24 07:55
• Updated: 25/Sep/24 19:28

Description

Initializing a Hunspell dictionary is a fairly costly process, as it involves reading and parsing fairly large files.
In my case, I have several collections that use the same set of 3 Hunspell dictionaries (they all use the same configset).
Dictionaries are initialized for each collection (and probably for each shard if there were any). This represents a significant overhead when starting up the Solr service.
Would it be possible to "pool" dictionaries across collections that use the same settings? In this way, the number of collections would have no effect on initialization time.

Translated with DeepL.com (free version)