[LUCENE-5391] UAX29URLEmailTokenizer should not tokenize no-scheme domain-only URLs that are followed by an alphanumeric character

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.7, 6.0
• Lucene Fields: New
• Assignee: Steven Rowe
• Reporter: Chris Geeringh
• Created: 09/Jan/14 21:36
• Updated: 28/Aug/22 13:58
• Resolved: 10/Jan/14 07:30

Description

The uax29urlemailtokenizer tokenises index2.php as:

<URL> index2.ph
<ALPHANUM> p

While it does not do the same for index.php

Screenshot from analyser: http://postimg.org/image/aj6c98n3b/

Issue Links

• breaks: LUCENE-8278 UAX29URLEmailTokenizer is not detecting some tokens as URL type