Lucene - Core
  1. Lucene - Core
  2. LUCENE-1116

contrib.benchmark.quality package improvements

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 2.2
    • Fix Version/s: 2.3
    • Component/s: modules/benchmark
    • Labels:
      None
    • Lucene Fields:
      New, Patch Available

      Description

      Few fixes and improvements for the search quality benchmark package:

      • flush report and logger at the end (otherwise long submission reports might miss last lines).
      • add run-tag-name to submission report (API change).
      • add control over max-#queries to run (useful at debugging a quality evaluation setup).
      • move control over max-docs-to-retrieve from benchmark constructor to a setter method (API change).
      • add computation of Mean Reciprocal Rank (MRR) in QualityStats.
      • QualityStats fixed to not fail if there are no results to average.
      • Add a TREC queries reader adequate for the 1MQ track (track started 2007).

      All tests pass, will commit this in 1-2 days if there is no objection.

        Activity

        Doron Cohen created issue -
        Doron Cohen made changes -
        Field Original Value New Value
        Attachment lucene-1116.patch [ 12372423 ]
        Doron Cohen made changes -
        Lucene Fields [Patch Available, New] [New, Patch Available]
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Michael Busch made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Mark Thomas made changes -
        Workflow jira [ 12420102 ] Default workflow, editable Closed status [ 12562425 ]
        Mark Thomas made changes -
        Workflow Default workflow, editable Closed status [ 12562425 ] jira [ 12583403 ]

          People

          • Assignee:
            Doron Cohen
            Reporter:
            Doron Cohen
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development