Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-9071

Speed up computation of BM25 scores

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 8.4
    • None
    • None
    • New

    Description

      We changed the way BM25 scores are computed in LUCENE-7997 in order to guarantee monotonicity of scores, but this translated to a small decrease of throughput, see annotation CC (October 2017) on Mike's nightly benchmarks. Even though the total number of score computations has decreased since we introduced block-max WAND, its relative cost is not negligible since we not only compute scores on collected documents, but also when decoding skip lists in order to compute the maximum score per block, or group of blocks.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              jpountz Adrien Grand
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h
                  2h