Lucene - Core
  1. Lucene - Core
  2. LUCENE-627

highlighter problems with overlapping tokens

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.1
    • Fix Version/s: 2.1
    • Component/s: core/other
    • Labels:
      None

      Description

      The lucene highlighter has problems when tokens that overlap are generated.

      For example, if analysis of iPod generates the tokens "i", "pod", "ipod" (with pod and ipod in the same position),
      then the highlighter will output this as iipod, regardless of if any of those tokens are highlighted.

      Discovered via http://issues.apache.org/jira/browse/SOLR-24

      1. Highlighter.java.diff
        2 kB
        Kerang Lv
      2. highlight_overlap.diff
        18 kB
        Yonik Seeley

        Issue Links

          Activity

          Yonik Seeley created issue -
          Yonik Seeley made changes -
          Field Original Value New Value
          Attachment highlight_overlap.diff [ 12336906 ]
          Yonik Seeley made changes -
          Resolution Fixed [ 1 ]
          Fix Version/s 2.0.1 [ 12311932 ]
          Status Open [ 1 ] Resolved [ 5 ]
          Kerang Lv made changes -
          Attachment Highlighter.java.diff [ 12340628 ]
          Mark Thomas made changes -
          Workflow jira [ 12375399 ] Default workflow, editable Closed status [ 12562326 ]
          Mark Thomas made changes -
          Workflow Default workflow, editable Closed status [ 12562326 ] jira [ 12583324 ]
          Uwe Schindler made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          David Smiley made changes -
          Link This issue relates to LUCENE-6139 [ LUCENE-6139 ]

            People

            • Assignee:
              Unassigned
              Reporter:
              Yonik Seeley
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development