[SOLR-1204] Enhance SpellingQueryConverter to handle UTF-8 instead of ASCII only

• Type: Improvement
• Status: Closed
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 1.3
• Fix Version/s: 1.4
• Component/s: spellchecker
• Assignee: Shalin Shekhar Mangar
• Reporter: Michael Ludwig
• Created: 05/Jun/09 07:55
• Updated: 10/Nov/09 15:52
• Resolved: 05/Jun/09 10:24

Description

Solr - User - SpellCheckComponent: queryAnalyzerFieldType
http://www.nabble.com/SpellCheckComponent%3A-queryAnalyzerFieldType-td23870668.html

In the above thread, it was suggested to extend the SpellingQueryConverter to cover the full UTF-8 range instead of handling US-ASCII only. This might be as simple as changing the regular expression used to tokenize the input string to accept a sequence of one or more Unicode letters ( \p

{L}

+ ) instead of a sequence of one or more word characters ( \w+ ).

See http://java.sun.com/j2se/1.4.2/docs/api/java/util/regex/Pattern.html for Java regular expression reference.

Issue Links

• is cloned by: SOLR-1407 SpellingQueryConverter now disallows underscores and digits in field names (but allows all UTF-8 letters)