Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-7452

json facet api returning inconsistent counts in cloud set up

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 5.1
    • 7.0
    • Facet Module

    Description

      While using the newly added feature of json term facet api (http://yonik.com/json-facet-api/#TermsFacet) I am encountering inconsistent returns of counts of faceted value ( Note I am running on a cloud mode of solr). For example consider that i have txns_id(unique field or key), consumer_number and amount. Now for a 10 million such records , lets say i query for

      q=:&rows=0&
      json.facet={
      biskatoo:{
      type : terms,
      field : consumer_number,
      limit : 20,
      sort :

      {y:desc}

      ,
      numBuckets : true,
      facet:

      { y : "sum(amount)" }

      }
      }

      the results are as follows ( some are omitted ):

      "facets":{
      "count":6641277,
      "biskatoo":{
      "numBuckets":3112708,
      "buckets":[

      { "val":"surya", "count":4, "y":2.264506}

      ,

      { "val":"raghu", "COUNT":3, // capitalised for recognition "y":1.8}

      ,

      { "val":"malli", "count":4, "y":1.78}

      ]}}}

      but if i restrict the query to

      q=consumer_number:raghu&rows=0&
      json.facet={
      biskatoo:{
      type : terms,
      field : consumer_number,
      limit : 20,
      sort :

      {y:desc}

      ,
      numBuckets : true,
      facet:

      { y : "sum(amount)" }

      }
      }

      i get :

      "facets":{
      "count":4,
      "biskatoo":{
      "numBuckets":1,
      "buckets":[

      { "val":"raghu", "COUNT":4, "y":2429708.24}

      ]}}}

      One can see the count results are inconsistent ( and I found many occasions of inconsistencies).

      I have tried the patch https://issues.apache.org/jira/browse/SOLR-7412 but still the issue seems not resolved

      Attachments

        1. SOLR-7452.patch
          8 kB
          Yonik Seeley
        2. SOLR-7452.patch
          26 kB
          Yonik Seeley
        3. SOLR-7452.patch
          64 kB
          Yonik Seeley

        Issue Links

          Activity

            People

              yseeley@gmail.com Yonik Seeley
              iamvamsi Vamsi Krishna D
              Votes:
              16 Vote for this issue
              Watchers:
              25 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 96h
                  96h
                  Remaining:
                  Remaining Estimate - 96h
                  96h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified