Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-2773

Don't create compound file for large segments by default

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.9.4, 3.0.3, 3.1, 4.0-ALPHA
    • core/index
    • None
    • New

    Description

      Spinoff from LUCENE-2762.

      CFS is useful for keeping the open file count down. But, it costs
      some added time during indexing to build, and also ties up temporary
      disk space, causing eg a large spike on the final merge of an
      optimize.

      Since MergePolicy dictates which segments should be CFS, we can
      change it to only build CFS for "smallish" merges.

      I think we should also set a maxMergeMB by default so that very large
      merges aren't done.

      Attachments

        1. LUCENE-2773.patch
          13 kB
          Michael McCandless

        Activity

          People

            mikemccand Michael McCandless
            mikemccand Michael McCandless
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: