Lucene - Core
  1. Lucene - Core
  2. LUCENE-4600

Explore facets aggregation during documents collection

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.2, 5.0
    • Component/s: modules/facet
    • Labels:
      None
    • Lucene Fields:
      New, Patch Available

      Description

      Today the facet module simply gathers all hits (as a bitset, optionally with a float[] to hold scores as well, if you will aggregate them) during collection, and then at the end when you call getFacetsResults(), it makes a 2nd pass over all those hits doing the actual aggregation.

      We should investigate just aggregating as we collect instead, so we don't have to tie up transient RAM (fairly small for the bit set but possibly big for the float[]).

      1. LUCENE-4600.patch
        10 kB
        Michael McCandless
      2. LUCENE-4600.patch
        17 kB
        Michael McCandless
      3. LUCENE-4600-cli.patch
        24 kB
        Michael McCandless
      4. LUCENE-4600.patch
        85 kB
        Shai Erera
      5. LUCENE-4600.patch
        85 kB
        Shai Erera
      6. LUCENE-4600.patch
        110 kB
        Shai Erera
      7. LUCENE-4600.patch
        114 kB
        Shai Erera
      8. LUCENE-4600.patch
        96 kB
        Shai Erera

        Issue Links

          Activity

          Michael McCandless created issue -
          Michael McCandless made changes -
          Field Original Value New Value
          Attachment LUCENE-4600.patch [ 12560039 ]
          Michael McCandless made changes -
          Attachment LUCENE-4600.patch [ 12560047 ]
          Shai Erera made changes -
          Summary Facets should aggregate during collection, not at the end Explore facets aggregation during documents collection
          Michael McCandless made changes -
          Attachment LUCENE-4600-cli.patch [ 12560107 ]
          Shai Erera made changes -
          Component/s modules/facet [ 12314601 ]
          Shai Erera made changes -
          Attachment LUCENE-4600.patch [ 12565479 ]
          Shai Erera made changes -
          Attachment LUCENE-4600.patch [ 12565549 ]
          Shai Erera made changes -
          Attachment LUCENE-4600.patch [ 12565670 ]
          Shai Erera made changes -
          Attachment LUCENE-4600.patch [ 12565688 ]
          Shai Erera made changes -
          Attachment LUCENE-4600.patch [ 12565734 ]
          Shai Erera made changes -
          Link This issue contains LUCENE-4619 [ LUCENE-4619 ]
          Shai Erera made changes -
          Assignee Shai Erera [ shaie ]
          Shai Erera made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Lucene Fields New [ 10121 ] New,Patch Available [ 10121, 10120 ]
          Fix Version/s 4.2 [ 12323899 ]
          Fix Version/s 5.0 [ 12321663 ]
          Resolution Fixed [ 1 ]
          Uwe Schindler made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Shai Erera
              Reporter:
              Michael McCandless
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development