Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-8068

Allow IndexWriter to write a single DWPT to disk

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 7.2, 8.0
    • None
    • None
    • New, Patch Available

    Description

      Today we IW can only flush a DWPT to disk if an external resource calls flush() or refreshes a NRT reader or if a DWPT is selected as flush pending. Yet, the latter has the problem that it always ties up an indexing thread and if flush / NRT refresh is called a whole bunch of indexing threads is tied up. If IW could offer a simple `flushNextBuffer()` method that synchronously flushes the next pending or biggest active buffer to disk memory could be controlled in a more fine granular fashion from outside of the IW. This is for instance useful if more than one IW (shards) must be maintained in a single JVM / system.

      Attachments

        1. LUCENE-8068.patch
          16 kB
          Simon Willnauer
        2. LUCENE-8068.patch
          15 kB
          Simon Willnauer
        3. LUCENE-8068.patch
          15 kB
          Simon Willnauer
        4. LUCENE-8068.patch
          14 kB
          Simon Willnauer

        Issue Links

          Activity

            People

              Unassigned Unassigned
              simonw Simon Willnauer
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: