Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-12572

Reuse fieldvalues computed while sorting at writing in ExportWriter

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 7.5, 8.0
    • streaming expressions
    • None

    Description

      While exporting result through "/export" handler,

      http://localhost:8983/solr/core_name/export?q=my-query&sort=severity+desc,timestamp+desc&fl=severity,timestamp,msg
      

      Doc-values are sought for all the sort fields defined (in this example 'severity, 'timestamp'). When we stream out docs we again make doc-value seeks against the fl fields ('severity','timestamp','msg') .

      In most common use-cases we have fl = sort fields, or atleast the sort fields are subset of fl fields, so if we can pre-collect the values while sorting it, we can reduce the doc-value seeks potentially bringing speed improvement.

      Attachments

        1. SOLR-12572.patch
          30 kB
          Varun Thacker
        2. SOLR-12572.patch
          29 kB
          Varun Thacker
        3. SOLR-12572.patch
          26 kB
          Varun Thacker
        4. SOLR-12572.patch
          25 kB
          Amrit Sarkar
        5. SOLR-12572.patch
          28 kB
          Amrit Sarkar
        6. SOLR-12572.patch
          23 kB
          Amrit Sarkar
        7. SOLR-12572.patch
          17 kB
          Amrit Sarkar
        8. SOLR-12572.patch
          150 kB
          Amrit Sarkar

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            varun Varun Thacker
            sarkaramrit2@gmail.com Amrit Sarkar
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment