[LUCENE-4201] Add Japanese character filter to normalize iteration marks

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0-ALPHA, 6.0
• Fix Version/s: 4.0-BETA
• Component/s: modules/analysis
• Lucene Fields: New
• Assignee: Christian Moen
• Reporter: Christian Moen
• Created: 06/Jul/12 15:50
• Updated: 28/Aug/22 13:21
• Resolved: 10/Jul/12 13:03

Description

For some applications it might be useful to normalize kanji and kana iteration marks such as 々, ゞ, ゝ, ヽ and ヾ to make sure they are treated uniformly.