[LUCENE-503] Contrib: ThaiAnalyzer to enable Thai full-text search in Lucene

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4
• Component/s: modules/analysis
• Assignee: Chris M. Hostetter
• Reporter: Samphan Raruenrom
• Created: 01/Mar/06 19:44
• Updated: 28/Aug/22 11:25
• Resolved: 06/Jun/06 00:28

Description

Thai text don't have space between words. Usually, a dictionary-based algorithm is used to break string into words. For Lucene to be usable for Thai, an Analyzer that know how to break Thai words is needed.

I've implemented such Analyzer, ThaiAnalyzer, using ICU4j DictionaryBasedBreakIterator for word breaking. I'll upload the code later.

I'm normally a C++ programmer and very new to Java. Please review the code for any problem. One possible problem is that it requires ICU4j. I don't know whether this is OK.