Lucene - Core
  1. Lucene - Core
  2. LUCENE-2097

In NRT mode, and CFS enabled, IndexWriter incorrectly ties up disk space

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 2.9, 2.9.1, 3.0
    • Fix Version/s: 3.1, 4.0-ALPHA
    • Component/s: core/index
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      Spinoff of java-user thread titled "searching while optimize"...

      If IndexWriter is in NRT mode (you've called getReader() at least
      once), and CFS is enabled, then internally the writer pools readers.
      However, after a merge completes, it opens the reader against het
      non-CFS segment files, and pools that. It then builds the CFS file,
      as well, thus tying up the storage for that segment twice.

      Functionally the bug is harmless (it's only a disk space issue).
      Also, when the segment is merged, the disk space is released again
      (though the newly merged segment will also be double-tied-up).

      Simple workaround is to use non-CFS mode, or, don't use getReader.

      1. LUCENE-2097.patch
        2 kB
        Michael McCandless

        Activity

        Grant Ingersoll made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Michael McCandless made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Fix Version/s 3.1 [ 12314822 ]
        Resolution Fixed [ 1 ]
        Mark Thomas made changes -
        Workflow Default workflow, editable Closed status [ 12563360 ] jira [ 12584194 ]
        Mark Thomas made changes -
        Workflow jira [ 12483238 ] Default workflow, editable Closed status [ 12563360 ]
        Michael McCandless made changes -
        Field Original Value New Value
        Attachment LUCENE-2097.patch [ 12426358 ]
        Michael McCandless created issue -

          People

          • Assignee:
            Michael McCandless
            Reporter:
            Michael McCandless
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development