Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-756

Maintain norms in a single file .nrm

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 2.1
    • core/index
    • None
    • Patch Available

    Description

      Non-compound indexes are ~10% faster at indexing, and perform 50% IO activity comparing to compound indexes. But their file descriptors foot print is much higher.

      By maintaining all field norms in a single .nrm file, we can bound the number of files used by non compound indexes, and possibly allow more applications to use this format.

      More details on the motivation for this in: http://www.nabble.com/potential-indexing-perormance-improvement-for-compound-index---cut-IO---have-more-files-though-tf2826909.html (in particular http://www.nabble.com/Re%3A-potential-indexing-perormance-improvement-for-compound-index---cut-IO---have-more-files-though-p7910403.html).

      Attachments

        1. index.premergednorms.cfs.zip
          2 kB
          Michael McCandless
        2. index.premergednorms.nocfs.zip
          5 kB
          Michael McCandless
        3. LUCENE-756-Jan16.patch
          16 kB
          Michael McCandless
        4. LUCENE-756-Jan16.Take2.patch
          18 kB
          Michael McCandless
        5. nrm.patch.2.txt
          16 kB
          Doron Cohen
        6. nrm.patch.3.txt
          23 kB
          Doron Cohen
        7. nrm.patch.txt
          12 kB
          Doron Cohen

        Activity

          People

            doronc Doron Cohen
            doronc Doron Cohen
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: