Lucene - Core
  1. Lucene - Core
  2. LUCENE-1889

FastVectorHighlighter: support for additional queries

    Details

    • Type: Wish Wish
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.5, 4.0-ALPHA
    • Component/s: modules/highlighter
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      I am using fastvectorhighlighter for some strange languages and it is working well!

      One thing i noticed immediately is that many query types are not highlighted (multitermquery, multiphrasequery, etc)
      Here is one thing Michael M posted in the original ticket:

      I think a nice [eventual] model would be if we could simply re-run the
      scorer on the single document (using InstantiatedIndex maybe, or
      simply some sort of wrapper on the term vectors which are already a
      mini-inverted-index for a single doc), but extend the scorer API to
      tell us the exact term occurrences that participated in a match (which
      I don't think is exposed today).

      Due to strange requirements I am using something similar to this (but specialized to our case).
      I am doing strange things like forcing multitermqueries to rewrite into boolean queries so they will be highlighted,
      and flattening multiphrasequeries into boolean or'ed phrasequeries.
      I do not think these things would be 'fast', but i had a few ideas that might help:

      • looking at contrib/highlighter, you can support FilteredQuery in flatten() by calling getQuery() right?
      • maybe as a last resort, try Query.extractTerms() ?
      1. LUCENE-1889-solr.patch
        0.8 kB
        Mike Sokolov
      2. LUCENE-1889.patch
        18 kB
        Mike Sokolov
      3. LUCENE-1889.patch
        14 kB
        Mike Sokolov
      4. LUCENE-1889.patch
        15 kB
        Mike Sokolov
      5. LUCENE-1889_reader.patch
        2 kB
        Robert Muir

        Issue Links

          Activity

          Robert Muir created issue -
          Koji Sekiguchi made changes -
          Field Original Value New Value
          Link This issue relates to LUCENE-2243 [ LUCENE-2243 ]
          Robert Muir made changes -
          Component/s contrib/highlighter [ 12312096 ]
          Component/s contrib/* [ 12312028 ]
          Mark Thomas made changes -
          Workflow jira [ 12474884 ] Default workflow, editable Closed status [ 12563497 ]
          Mark Thomas made changes -
          Workflow Default workflow, editable Closed status [ 12563497 ] jira [ 12585093 ]
          Mike Sokolov made changes -
          Attachment LUCENE-1889.patch [ 12483830 ]
          Mike Sokolov made changes -
          Attachment LUCENE-1889.patch [ 12492986 ]
          Mike Sokolov made changes -
          Attachment LUCENE-1889.patch [ 12493705 ]
          Koji Sekiguchi made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Assignee Koji Sekiguchi [ koji ]
          Fix Version/s 3.5 [ 12317877 ]
          Fix Version/s 4.0 [ 12314025 ]
          Resolution Fixed [ 1 ]
          Chris Male made changes -
          Resolution Fixed [ 1 ]
          Status Resolved [ 5 ] Reopened [ 4 ]
          Robert Muir made changes -
          Attachment LUCENE-1889_reader.patch [ 12493731 ]
          Mike Sokolov made changes -
          Attachment LUCENE-1889-solr.patch [ 12493764 ]
          Koji Sekiguchi made changes -
          Status Reopened [ 4 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Uwe Schindler made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Hoss Man made changes -
          Link This issue breaks SOLR-7488 [ SOLR-7488 ]

            People

            • Assignee:
              Koji Sekiguchi
              Reporter:
              Robert Muir
            • Votes:
              4 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development