[LUCENE-1824] FastVectorHighlighter truncates words at beginning and end of fragments

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 3.5, 4.0-ALPHA
• Component/s: modules/highlighter

Environment

any

• Lucene Fields: New, Patch Available
• Assignee: Koji Sekiguchi
• Reporter: Alex Vigdor
• Created: 19/Aug/09 00:41
• Updated: 28/Aug/22 12:06
• Resolved: 08/Sep/11 13:05

Description

FastVectorHighlighter does not take word boundaries into consideration when building fragments, so that in most cases the first and last word of a fragment are truncated. This makes the highlights less legible than they should be. I will attach a patch to BaseFragmentBuilder that resolves this by expanding the start and end boundaries of the fragment to the first whitespace character on either side of the fragment, or the beginning or end of the source text, whichever comes first. This significantly improves legibility, at the cost of returning a slightly larger number of characters than specified for the fragment size.

Issue Links

• is depended upon by: SOLR-2749 use BoundaryScanner in Solr FVH