Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-12616

Track down performance slowdowns with ExportWriter

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 7.5, 8.0
    • streaming expressions
    • None

    Description

      Just to be clear for users glancing through this Jira : The performance slowdown is currently on an unreleased version of Solr so no versions are affected by this.

      While doing some benchmarking for SOLR-12572 , I compared the export writers performance against Solr 7.4 and there seems to be some slowdowns that have been introduced. Most likely this is because of SOLR-11598

      In an 1 shard 1 replica collection with 25M docs. We issue the following query 

      /export?q=*:*&sort=id desc&fl=id

      Solr 7.4 took 8:10 , 8:20 and 8:22 in the 3 runs that I did

      Master took 10:46

      Amrit's done some more benchmarking so he can fill in with some more numbers here. 

       

      Attachments

        1. SOLR-12616.patch
          17 kB
          Varun Thacker
        2. SingleSortValue-2.png
          534 kB
          Amrit Sarkar
        3. SingleSortValue-1.png
          410 kB
          Amrit Sarkar
        4. DefaultCode-2.png
          255 kB
          Amrit Sarkar
        5. DefaultCode-1.png
          565 kB
          Amrit Sarkar
        6. SOLR-12616.patch
          4 kB
          Varun Thacker

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            varun Varun Thacker
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment