Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-8068

Allow IndexWriter to write a single DWPT to disk

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 7.2, 8.0
    • Component/s: None
    • Labels:
      None
    • Lucene Fields:
      New, Patch Available

      Description

      Today we IW can only flush a DWPT to disk if an external resource calls flush() or refreshes a NRT reader or if a DWPT is selected as flush pending. Yet, the latter has the problem that it always ties up an indexing thread and if flush / NRT refresh is called a whole bunch of indexing threads is tied up. If IW could offer a simple `flushNextBuffer()` method that synchronously flushes the next pending or biggest active buffer to disk memory could be controlled in a more fine granular fashion from outside of the IW. This is for instance useful if more than one IW (shards) must be maintained in a single JVM / system.

        Attachments

        1. LUCENE-8068.patch
          14 kB
          Simon Willnauer
        2. LUCENE-8068.patch
          15 kB
          Simon Willnauer
        3. LUCENE-8068.patch
          15 kB
          Simon Willnauer
        4. LUCENE-8068.patch
          16 kB
          Simon Willnauer

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                simonw Simon Willnauer
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: