[LUCENE-627] highlighter problems with overlapping tokens

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1
• Fix Version/s: 2.1
• Component/s: core/other
• Assignee: Unassigned
• Reporter: Yonik Seeley
• Created: 14/Jul/06 00:10
• Updated: 28/Aug/22 11:29
• Resolved: 16/Jul/06 03:19

Description

The lucene highlighter has problems when tokens that overlap are generated.

For example, if analysis of iPod generates the tokens "i", "pod", "ipod" (with pod and ipod in the same position),
then the highlighter will output this as iipod, regardless of if any of those tokens are highlighted.

Discovered via http://issues.apache.org/jira/browse/SOLR-24

Issue Links

• relates to: LUCENE-6139 TokenGroup.getStart|EndOffset should return matchStart|EndOffset not start|endOffset