[LUCENE-180] [PATCH] Language guesser contribution

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Component/s: core/other

Environment

Operating System: other
Platform: Other

• Bugzilla Id: 26763
• Assignee: Unassigned
• Reporter: Jean-François Halleux
• Created: 08/Feb/04 02:57
• Updated: 28/Aug/22 11:15
• Resolved: 18/Jan/08 14:20

Description

Hello,

I'd like to contribute this language guesser to Lucene.

It contains language guessing interfaces and classes as well as trigram
specific classes and some language reference files I generated myself using the
trigram file generation utily in there. I included a unit test as well.

I didn't do any extensive tests on guessing quality and performance but I would
tend to think that they are both OK for a first pass.

I thought about writing a custom Analyzer for this but realized that this
wouldn't be the way to go and that probably the language decision should be
left to the developper, definitely when the Analyzer is used to tokenize a
query.

Have fun,

Jean-François Halleux