[LUCENE-9930] UkrainianMorfologikAnalyzer reloads its Dictionary for every new TokenStreamComponents instance

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 9.0
• Lucene Fields: New
• Assignee: Alan Woodward
• Reporter: Alan Woodward
• Created: 15/Apr/21 08:39
• Updated: 28/Aug/22 16:20
• Resolved: 29/Apr/21 08:11

Description

Large static data structures should be loaded in Analyzer constructors and shared between threads, but the UkrainianMorfologikAnalyzer is loading its dictionary in `createComponents`, which means it is reloaded and stored on every new analysis thread. If you have a large dictionary and highly concurrent indexing then this can lead to you running out of memory as multiple copies of the dictionary are held in thread locals.

Issue Links

• links to: GitHub Pull Request #109