[LUCENE-9253] Support custom dictionaries in KoreanTokenizer

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 9.0, 8.5
• Lucene Fields: New
• Assignee: Namgyu Kim
• Reporter: Namgyu Kim
• Created: 27/Feb/20 17:56
• Updated: 28/Aug/22 15:59
• Resolved: 03/Mar/20 16:24

Description

KoreanTokenizer does not support custom dictionaries(system, unknown) now, even though Nori provides DictionaryBuilder that creates custom dictionary.
In the current state, it is very difficult for Nori users to use a custom dictionary.
Therefore, we need to open a new constructor that uses it.
Kuromoji is already supported(LUCENE-8971) that, and I referenced it.

Issue Links

• links to: GitHub Pull Request #1296