Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-4600

Explore facets aggregation during documents collection

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.2, 6.0
    • Component/s: modules/facet
    • Labels:
      None
    • Lucene Fields:
      New, Patch Available

      Description

      Today the facet module simply gathers all hits (as a bitset, optionally with a float[] to hold scores as well, if you will aggregate them) during collection, and then at the end when you call getFacetsResults(), it makes a 2nd pass over all those hits doing the actual aggregation.

      We should investigate just aggregating as we collect instead, so we don't have to tie up transient RAM (fairly small for the bit set but possibly big for the float[]).

        Attachments

        1. LUCENE-4600.patch
          10 kB
          Michael McCandless
        2. LUCENE-4600.patch
          17 kB
          Michael McCandless
        3. LUCENE-4600-cli.patch
          24 kB
          Michael McCandless
        4. LUCENE-4600.patch
          85 kB
          Shai Erera
        5. LUCENE-4600.patch
          85 kB
          Shai Erera
        6. LUCENE-4600.patch
          110 kB
          Shai Erera
        7. LUCENE-4600.patch
          114 kB
          Shai Erera
        8. LUCENE-4600.patch
          96 kB
          Shai Erera

          Issue Links

            Activity

              People

              • Assignee:
                shaie Shai Erera
                Reporter:
                mikemccand Michael McCandless
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: