Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-3129

Single-pass grouping collector based on doc blocks

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 3.2, 4.0-ALPHA
    • modules/grouping
    • None
    • New

    Description

      LUCENE-3112 enables adding/updating a contiguous block of documents to
      the index, guaranteed (yet, experimental!) to retain adjacent docID
      assignment through the full life of the index as long the app doesn't
      delete individual docs from the block.

      When an app does this, it can enable neat features like LUCENE-2454
      (nested documents), post-group facet counting (LUCENE-3097).

      It also makes single-pass grouping possible, when you group by
      the "identifier" field shared by the doc block, since we know we will
      see a given group only once with all of its docs within one block.

      This should be faster than the fully general two-pass collectors we
      already have.

      I'm working on a patch but not quite there yet...

      Attachments

        1. LUCENE-3129.patch
          47 kB
          Michael McCandless
        2. LUCENE-3129.patch
          47 kB
          Michael McCandless
        3. LUCENE-3129.patch
          82 kB
          Michael McCandless

        Issue Links

          Activity

            People

              mikemccand Michael McCandless
              mikemccand Michael McCandless
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: