Issue Details (XML | Word | Printable)

Key: LUCENE-756
Type: Improvement Improvement
Status: Closed Closed
Resolution: Fixed
Priority: Minor Minor
Assignee: Doron Cohen
Reporter: Doron Cohen
Votes: 0
Watchers: 0
Operations

If you were logged in you would be able to see more operations.
Lucene - Java

Maintain norms in a single file .nrm

Created: 21/Dec/06 02:10 AM   Updated: 27/Feb/07 06:10 PM
Return to search
Component/s: Index
Affects Version/s: None
Fix Version/s: 2.1

Time Tracking:
Not Specified

File Attachments:
  Size
Zip Archive Licensed for inclusion in ASF works index.premergednorms.cfs.zip 2007-01-16 04:36 PM Michael McCandless 2 kB
Zip Archive Licensed for inclusion in ASF works index.premergednorms.nocfs.zip 2007-01-16 04:36 PM Michael McCandless 5 kB
Text File Licensed for inclusion in ASF works LUCENE-756-Jan16.patch 2007-01-16 04:36 PM Michael McCandless 16 kB
Text File Licensed for inclusion in ASF works LUCENE-756-Jan16.Take2.patch 2007-01-16 05:50 PM Michael McCandless 18 kB
Text File Licensed for inclusion in ASF works nrm.patch.2.txt 2006-12-22 08:51 AM Doron Cohen 16 kB
Text File Licensed for inclusion in ASF works nrm.patch.3.txt 2007-01-03 10:49 PM Doron Cohen 23 kB
Text File Licensed for inclusion in ASF works nrm.patch.txt 2006-12-21 04:26 AM Doron Cohen 12 kB

Lucene Fields: Patch Available
Resolution Date: 16/Jan/07 08:28 PM


 Description  « Hide
Non-compound indexes are ~10% faster at indexing, and perform 50% IO activity comparing to compound indexes. But their file descriptors foot print is much higher.

By maintaining all field norms in a single .nrm file, we can bound the number of files used by non compound indexes, and possibly allow more applications to use this format.

More details on the motivation for this in: http://www.nabble.com/potential-indexing-perormance-improvement-for-compound-index---cut-IO---have-more-files-though-tf2826909.html (in particular http://www.nabble.com/Re%3A-potential-indexing-perormance-improvement-for-compound-index---cut-IO---have-more-files-though-p7910403.html).



 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
Doron Cohen made changes - 21/Dec/06 02:10 AM
Field Original Value New Value
Assignee Doron Cohen [ doronc ]
Doron Cohen made changes - 21/Dec/06 02:15 AM
Attachment nrm.patch.txt [ 12347635 ]
Doron Cohen made changes - 21/Dec/06 03:00 AM
Lucene Fields [New] [Patch Available]
Doron Cohen made changes - 21/Dec/06 03:59 AM
Component/s Index [ 12310232 ]
Doron Cohen made changes - 21/Dec/06 04:07 AM
Attachment nrm.patch.txt [ 12347635 ]
Doron Cohen made changes - 21/Dec/06 04:26 AM
Attachment nrm.patch.txt [ 12347639 ]
Doron Cohen made changes - 22/Dec/06 08:51 AM
Attachment nrm.patch.2.txt [ 12347715 ]
Doron Cohen made changes - 03/Jan/07 10:49 PM
Attachment nrm.patch.3.txt [ 12348226 ]
Yonik Seeley made changes - 07/Jan/07 04:20 AM
Resolution Fixed [ 1 ]
Status Open [ 1 ] Resolved [ 5 ]
Michael McCandless made changes - 16/Jan/07 04:35 PM
Resolution Fixed [ 1 ]
Status Resolved [ 5 ] Reopened [ 4 ]
Michael McCandless made changes - 16/Jan/07 04:36 PM
Attachment LUCENE-756-Jan16.patch [ 12349015 ]
Michael McCandless made changes - 16/Jan/07 04:36 PM
Attachment index.premergednorms.cfs.zip [ 12349016 ]
Michael McCandless made changes - 16/Jan/07 04:36 PM
Attachment index.premergednorms.nocfs.zip [ 12349017 ]
Michael McCandless made changes - 16/Jan/07 05:50 PM
Attachment LUCENE-756-Jan16.Take2.patch [ 12349021 ]
Michael McCandless made changes - 16/Jan/07 08:28 PM
Resolution Fixed [ 1 ]
Status Reopened [ 4 ] Resolved [ 5 ]
Fix Version/s 2.1 [ 12310854 ]
Michael McCandless made changes - 27/Feb/07 06:10 PM
Status Resolved [ 5 ] Closed [ 6 ]