[SOLR-16885] Highlighter IndexOutOfBoundsException using termVectors

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 9.0
• Component/s: highlighter
• Assignee: Unassigned
• Reporter: Chris M. Hostetter
• Created: 10/Jul/23 18:57
• Updated: 20/Oct/23 16:25

Description

Beginning with Solr 9.0, schemas + data + queries that could be indexed & queried & highlighted in 8.x may throw exceptions that look like this when highlighting queries with multiple terms ...

java.lang.IndexOutOfBoundsException: start 8, end 7, length 16
   at java.lang.AbstractStringBuilder.checkRange(Unknown Source) ~[?:?]
   at java.lang.AbstractStringBuilder.append(Unknown Source) ~[?:?]
   at java.lang.StringBuilder.append(Unknown Source) ~[?:?]
   at org.apache.lucene.search.uhighlight.DefaultPassageFormatter.append(DefaultPassageFormatter.java:133) ~[?:?]
   at org.apache.lucene.search.uhighlight.DefaultPassageFormatter.format(DefaultPassageFormatter.java:84) ~[?:?]
   at org.apache.lucene.search.uhighlight.DefaultPassageFormatter.format(DefaultPassageFormatter.java:25) ~[?:?]
   at org.apache.lucene.search.uhighlight.FieldHighlighter.highlightFieldForDoc(FieldHighlighter.java:94) ~[?:?]
   at org.apache.lucene.search.uhighlight.UnifiedHighlighter.highlightFieldsAsObjects(UnifiedHighlighter.java:954) ~[?:?]
   at org.apache.lucene.search.uhighlight.UnifiedHighlighter.highlightFields(UnifiedHighlighter.java:824) ~[?:?]
   at org.apache.solr.highlight.UnifiedSolrHighlighter.doHighlighting(UnifiedSolrHighlighter.java:165) ~[?:?]

This problem can happen when the field has termVectors="true" termOffsets="true" but does NOT have termPositions="true"

Workaround is to update these fieldtypes to include termPositions="true" and re-index all data.

Issue Links

• is related to: SOLR-17003 UnifiedHighlighter breaks with DateRangeField
• links to: Root Cause: Lucene issue # 12431