[SOLR-3110] Search result comes up with truncated words at the start of highlighted fragment

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Affects Version/s: 4.0-ALPHA
• Component/s: highlighter
• Labels: FastVectorHighlighter boundaryScanner highlighting solr

Environment

java Tomcat Solaris

• Assignee: Unassigned
• Reporter: Shyam Bhaskaran
• Created: 08/Feb/12 07:29
• Updated: 02/Oct/16 07:34
• Resolved: 02/Oct/16 07:34

Description

It is being observed that words are getting truncated at the start of Highlighter fragment displayed.
Following boundary scanner settings are introduced inside in the solrconfig.xml file

<str name="hl.bs.chars">.,!? &#9;&#10;&#13;</str>

If I change the settings to

<str name="hl.bs.chars">.,!?</str>

then it is seen that this issue goes away but another issues comes up where the highlighted search fragment does not start from the beginning of the sentence.

Below is the complete list of setting we are using for boundary scanner.

<boundaryScanner name="simple" class="solr.highlight.SimpleBoundaryScanner" default="true">
<lst name="defaults">
<str name="hl.bs.maxScan">200</str>
<str name="hl.bs.chars">.,!? &#9;&#10;&#13;</str>
</lst>
</boundaryScanner>

<boundaryScanner name="breakIterator" class="solr.highlight.BreakIteratorBoundaryScanner">
<lst name="defaults">
<str name="hl.bs.type">SENTENCE</str>
<str name="hl.bs.language">en</str>
<str name="hl.bs.country">US</str>
</lst>
</boundaryScanner>

Issue Links

• is related to: LUCENE-1822 FastVectorHighlighter: SimpleFragListBuilder hard-coded 6 char margin is too naive