Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-8068

Allow IndexWriter to write a single DWPT to disk

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 7.2, 8.0
    • Component/s: None
    • Labels:
      None
    • Lucene Fields:
      New, Patch Available

      Description

      Today we IW can only flush a DWPT to disk if an external resource calls flush() or refreshes a NRT reader or if a DWPT is selected as flush pending. Yet, the latter has the problem that it always ties up an indexing thread and if flush / NRT refresh is called a whole bunch of indexing threads is tied up. If IW could offer a simple `flushNextBuffer()` method that synchronously flushes the next pending or biggest active buffer to disk memory could be controlled in a more fine granular fashion from outside of the IW. This is for instance useful if more than one IW (shards) must be maintained in a single JVM / system.

        Attachments

        1. LUCENE-8068.patch
          14 kB
          Simon Willnauer
        2. LUCENE-8068.patch
          15 kB
          Simon Willnauer
        3. LUCENE-8068.patch
          15 kB
          Simon Willnauer
        4. LUCENE-8068.patch
          16 kB
          Simon Willnauer

        Issue Links

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              simonw Simon Willnauer

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment