Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-2047

IndexWriter should immediately resolve deleted docs to docID in near-real-time mode

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • 4.9, 6.0
    • core/index
    • None
    • New

    Description

      Spinoff from LUCENE-1526.

      When deleteDocuments(Term) is called, we currently always buffer the
      Term and only later, when it's time to flush deletes, resolve to
      docIDs. This is necessary because we don't in general hold
      SegmentReaders open.

      But, when IndexWriter is in NRT mode, we pool the readers, and so
      deleting in the foreground is possible.

      It's also beneficial, in that in can reduce the turnaround time when
      reopening a new NRT reader by taking this resolution off the reopen
      path. And if multiple threads are used to do the deletion, then we
      gain concurrency, vs reopen which is not concurrent when flushing the
      deletes.

      Attachments

        1. LUCENE-2047.patch
          6 kB
          Jason Rutherglen
        2. LUCENE-2047.patch
          10 kB
          Jason Rutherglen
        3. LUCENE-2047.patch
          13 kB
          Jason Rutherglen
        4. LUCENE-2047.patch
          15 kB
          Jason Rutherglen
        5. LUCENE-2047.patch
          16 kB
          Jason Rutherglen
        6. LUCENE-2047.patch
          17 kB
          Jason Rutherglen
        7. LUCENE-2047.patch
          18 kB
          Jason Rutherglen

        Activity

          People

            mikemccand Michael McCandless
            mikemccand Michael McCandless
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: