[LUCENE-2399] Add support for ICU's Normalizer2

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1
• Fix Version/s: 3.1, 4.0-ALPHA
• Component/s: modules/other
• Lucene Fields: New, Patch Available
• Assignee: Robert Muir
• Reporter: Robert Muir
• Created: 17/Apr/10 02:31
• Updated: 28/Aug/22 12:24
• Resolved: 06/May/10 12:20

Description

While there are separate Case Folding, Normalization, and Ignorable-removal filters in LUCENE-1488,
the new ICU Normalizer2 API does this all at once with nfkc_cf (based on the new NFKC_Casefold property in Unicode).

This is great, because it provides a ton of unicode functionality that is really needed.
And the new Normalizer2 API takes CharSequence and writes to Appendable...

Issue Links

• is related to: LUCENE-1488 multilingual analyzer based on icu