[LUCENE-2910] Highlighter does not correctly highlight the phrase around 50th term

• Type: Bug
• Status: Open
• Priority: Trivial
• Resolution: Unresolved
• Affects Version/s: 2.9.4
• Component/s: modules/highlighter
• Lucene Fields: New, Patch Available
• Assignee: Unassigned
• Reporter: Shinya Kasatani
• Created: 07/Feb/11 09:28
• Updated: 28/Aug/22 12:40

Description

When you use the Highlighter combined with N-Gram tokenizers such as CJKTokenizer and try to highlight the phrase that appears around 50th term in the field, the highlighted phrase is shorter than expected.

e.g. Highlighting "fooo" in the following text with bigram tokenizer:
"0---------1---------2---------3---------4---------fooo---"

Expected: "0---------1---------2---------3---------4---------<B>fooo</B>---"
Actual: "0---------1---------2---------3---------4---------f<B>ooo</B>---"