Solr
  1. Solr
  2. SOLR-1166

speed up DocSet generation for term queries and avoid scoring for all queries.

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.4
    • Component/s: None
    • Labels:
      None

      Description

      Use subreaders, bypass scoring, and use more efficient termdocs APIs to speed up docset generation.

      1. SOLR-1166.patch
        7 kB
        Yonik Seeley
      2. SOLR-1166.patch
        8 kB
        Yonik Seeley

        Activity

        Hide
        Yonik Seeley added a comment -

        Attaching patch. Should be faster, but need to verify.

        Show
        Yonik Seeley added a comment - Attaching patch. Should be faster, but need to verify.
        Hide
        Shalin Shekhar Mangar added a comment -

        Yonik, did you rename DocSetHitCollector to DocSetCollector? There's no DocSetCollector in the patch.

        Show
        Shalin Shekhar Mangar added a comment - Yonik, did you rename DocSetHitCollector to DocSetCollector? There's no DocSetCollector in the patch.
        Hide
        Yonik Seeley added a comment -

        Oops, yes, I added a DocSetCollector which doesn't collect score() in addition to keeping the DocSetHitCollector (needed for the timed collector currently).

        Show
        Yonik Seeley added a comment - Oops, yes, I added a DocSetCollector which doesn't collect score() in addition to keeping the DocSetHitCollector (needed for the timed collector currently).
        Hide
        Yonik Seeley added a comment -

        updated patch.

        Show
        Yonik Seeley added a comment - updated patch.
        Hide
        Yonik Seeley added a comment -

        performance improvement for DocSet generation:
        ~14% for term filters that match a lot of documents
        ~10% for a boolean query with 2 optional terms that match a lot of docs

        I plan on committing shortly.

        Show
        Yonik Seeley added a comment - performance improvement for DocSet generation: ~14% for term filters that match a lot of documents ~10% for a boolean query with 2 optional terms that match a lot of docs I plan on committing shortly.
        Hide
        Yonik Seeley added a comment -

        committed.

        Show
        Yonik Seeley added a comment - committed.
        Hide
        Grant Ingersoll added a comment -

        Bulk close for Solr 1.4

        Show
        Grant Ingersoll added a comment - Bulk close for Solr 1.4

          People

          • Assignee:
            Yonik Seeley
            Reporter:
            Yonik Seeley
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development