Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-12572

Reuse fieldvalues computed while sorting at writing in ExportWriter

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 7.5, 8.0
    • Component/s: streaming expressions
    • Labels:
      None

      Description

      While exporting result through "/export" handler,

      http://localhost:8983/solr/core_name/export?q=my-query&sort=severity+desc,timestamp+desc&fl=severity,timestamp,msg
      

      Doc-values are sought for all the sort fields defined (in this example 'severity, 'timestamp'). When we stream out docs we again make doc-value seeks against the fl fields ('severity','timestamp','msg') .

      In most common use-cases we have fl = sort fields, or atleast the sort fields are subset of fl fields, so if we can pre-collect the values while sorting it, we can reduce the doc-value seeks potentially bringing speed improvement.

        Attachments

        1. SOLR-12572.patch
          150 kB
          Amrit Sarkar
        2. SOLR-12572.patch
          17 kB
          Amrit Sarkar
        3. SOLR-12572.patch
          23 kB
          Amrit Sarkar
        4. SOLR-12572.patch
          28 kB
          Amrit Sarkar
        5. SOLR-12572.patch
          25 kB
          Amrit Sarkar
        6. SOLR-12572.patch
          26 kB
          Varun Thacker
        7. SOLR-12572.patch
          29 kB
          Varun Thacker
        8. SOLR-12572.patch
          30 kB
          Varun Thacker

          Activity

            People

            • Assignee:
              varunthacker Varun Thacker
              Reporter:
              sarkaramrit2@gmail.com Amrit Sarkar
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: