Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-3129

Single-pass grouping collector based on doc blocks

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.2, 4.0-ALPHA
    • Component/s: modules/grouping
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      LUCENE-3112 enables adding/updating a contiguous block of documents to
      the index, guaranteed (yet, experimental!) to retain adjacent docID
      assignment through the full life of the index as long the app doesn't
      delete individual docs from the block.

      When an app does this, it can enable neat features like LUCENE-2454
      (nested documents), post-group facet counting (LUCENE-3097).

      It also makes single-pass grouping possible, when you group by
      the "identifier" field shared by the doc block, since we know we will
      see a given group only once with all of its docs within one block.

      This should be faster than the fully general two-pass collectors we
      already have.

      I'm working on a patch but not quite there yet...

        Attachments

        1. LUCENE-3129.patch
          47 kB
          Michael McCandless
        2. LUCENE-3129.patch
          47 kB
          Michael McCandless
        3. LUCENE-3129.patch
          82 kB
          Michael McCandless

          Issue Links

            Activity

              People

              • Assignee:
                mikemccand Michael McCandless
                Reporter:
                mikemccand Michael McCandless
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: