Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-9253

Support custom dictionaries in KoreanTokenizer

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: main (9.0), 8.5
    • Component/s: None
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      KoreanTokenizer does not support custom dictionaries(system, unknown) now, even though Nori provides DictionaryBuilder that creates custom dictionary.
      In the current state, it is very difficult for Nori users to use a custom dictionary.
      Therefore, we need to open a new constructor that uses it.
      Kuromoji is already supported(LUCENE-8971) that, and I referenced it.

        Attachments

          Activity

            People

            • Assignee:
              danmuzi Namgyu Kim
              Reporter:
              danmuzi Namgyu Kim

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 1h 10m
                1h 10m

                  Issue deployment