[LUCENE-2246] While indexing Turkish web pages, "Parse Aborted: Lexical error...." occurs

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0
• Fix Version/s: 3.1, 4.0-ALPHA
• Component/s: modules/examples
• Lucene Fields: New
• Assignee: Robert Muir
• Reporter: Selim Nadi
• Created: 31/Jan/10 22:30
• Updated: 28/Aug/22 12:19
• Resolved: 05/Nov/10 07:45

Description

When I try to index Turkish page if there is a Turkish specific character in the HTML specific tag HTML parser gives "Parse Aborted: Lexical error.on ... line" error.
For this case "<IMG SRC="../images/head.jpg" WIDTH=570 HEIGHT=47 BORDER=0 ALT="ş">" exception address "ş" character (which has 351 ascii value) as an error. OR ı character in title tag.
<a title="(ııı)">

Turkish character in the content do not create any problem.