Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-9253

Support custom dictionaries in KoreanTokenizer

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: master (9.0), 8.5
    • Component/s: None
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      KoreanTokenizer does not support custom dictionaries(system, unknown) now, even though Nori provides DictionaryBuilder that creates custom dictionary.
      In the current state, it is very difficult for Nori users to use a custom dictionary.
      Therefore, we need to open a new constructor that uses it.
      Kuromoji is already supported(LUCENE-8971) that, and I referenced it.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                danmuzi Namgyu Kim
                Reporter:
                danmuzi Namgyu Kim
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 10m
                  1h 10m