Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-10606

Optimize hit collection of prefilter in KnnVectorQuery for BitSet backed queries

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 9.3
    • core/search

    Description

      While working on this PR to add prefilter testing support, we saw that hit collection took a long time for BitSetIterator backed scorers (due to iteration over the entire underlying BitSet, and copying it into an internal one)

      These BitSetIterators can be frequent (as they are used in LRUQueryCache), and bulk collection can be optimized with more knowledge of the underlying iterator

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              kaivalnp Kaival Parikh
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 4h 20m
                  4h 20m