Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-8988

Improve facet.method=fcs performance in SolrCloud

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 5.5, 6.0
    • 6.1
    • None
    • None

    Description

      This relates to SOLR-8559 – which improves the algorithm used by fcs faceting when facet.mincount=1

      This patch allows facet.mincount to be sent as 1 for distributed queries. As far as I can tell there is no reason to set facet.mincount=0 for refinement purposes . After trying to make sense of all the refinement logic, I cant see how the difference between no value and value=0 would have a negative effect.

      Test perf:

      • ~15million unique terms
      • query matches ~3million documents

      Params:

      facet.mincount=1
      facet.limit=500
      facet.method=fcs
      facet.sort=count
      

      Average Time Per Request:

      • Before patch: ~20seconds
      • After patch: <1 second

      Note: all tests pass and in my test, the output was identical before and after patch.

      Attachments

        1. Screen Shot 2016-04-25 at 2.54.47 PM.png
          95 kB
          Keith Laban
        2. Screen Shot 2016-04-25 at 2.55.00 PM.png
          118 kB
          Keith Laban
        3. SOLR-8988.patch
          6 kB
          Keith Laban
        4. SOLR-8988.patch
          5 kB
          Dennis Gove
        5. SOLR-8988.patch
          5 kB
          Keith Laban
        6. SOLR-8988.patch
          1 kB
          Keith Laban

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            dpgove Dennis Gove
            k317h Keith Laban
            Votes:
            1 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment