[LUCENE-8866] Remove ICU dependency of kuromoji tools/test-tools

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 8.2
• Lucene Fields: New
• Assignee: Unassigned
• Reporter: Robert Muir
• Created: 18/Jun/19 01:44
• Updated: 28/Aug/22 15:47
• Resolved: 21/Jun/19 01:27

Description

The tooling stuff has an off-by-default option to normalize entries, currently using the ICU api.

But I think since its off-by-default, and just doing NFKC normalization at dictionary-build-time, its a better tradeoff to use the JDK here?

I would rather remove the ICU dependency for the tooling and look at simplifying the build to have less modules (e.g. investigate moving the tooling and tests into src/java and src/tools, so that [e-mail] new tests in LUCENE-8863 are running by default, dictionary tool is shipped as a commandline tool in the JAR, etc)

"ant regenerate" should be enough to prevent any chicken-and-eggs in the dictionary construction code, so I don't think we need separate modules to enforce it.