Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-7452

json facet api returning inconsistent counts in cloud set up

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 5.1
    • Fix Version/s: 7.0
    • Component/s: Facet Module
    • Labels:

      Description

      While using the newly added feature of json term facet api (http://yonik.com/json-facet-api/#TermsFacet) I am encountering inconsistent returns of counts of faceted value ( Note I am running on a cloud mode of solr). For example consider that i have txns_id(unique field or key), consumer_number and amount. Now for a 10 million such records , lets say i query for

      q=:&rows=0&
      json.facet={
      biskatoo:{
      type : terms,
      field : consumer_number,
      limit : 20,
      sort :

      {y:desc}

      ,
      numBuckets : true,
      facet:

      { y : "sum(amount)" }

      }
      }

      the results are as follows ( some are omitted ):

      "facets":{
      "count":6641277,
      "biskatoo":{
      "numBuckets":3112708,
      "buckets":[

      { "val":"surya", "count":4, "y":2.264506}

      ,

      { "val":"raghu", "COUNT":3, // capitalised for recognition "y":1.8}

      ,

      { "val":"malli", "count":4, "y":1.78}

      ]}}}

      but if i restrict the query to

      q=consumer_number:raghu&rows=0&
      json.facet={
      biskatoo:{
      type : terms,
      field : consumer_number,
      limit : 20,
      sort :

      {y:desc}

      ,
      numBuckets : true,
      facet:

      { y : "sum(amount)" }

      }
      }

      i get :

      "facets":{
      "count":4,
      "biskatoo":{
      "numBuckets":1,
      "buckets":[

      { "val":"raghu", "COUNT":4, "y":2429708.24}

      ]}}}

      One can see the count results are inconsistent ( and I found many occasions of inconsistencies).

      I have tried the patch https://issues.apache.org/jira/browse/SOLR-7412 but still the issue seems not resolved

        Attachments

        1. SOLR-7452.patch
          64 kB
          Yonik Seeley
        2. SOLR-7452.patch
          26 kB
          Yonik Seeley
        3. SOLR-7452.patch
          8 kB
          Yonik Seeley

          Issue Links

            Activity

              People

              • Assignee:
                yseeley@gmail.com Yonik Seeley
                Reporter:
                iamvamsi Vamsi Krishna D
              • Votes:
                16 Vote for this issue
                Watchers:
                31 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 96h
                  96h
                  Remaining:
                  Remaining Estimate - 96h
                  96h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified