Issue Details (XML | Word | Printable)

Key: LUCENE-550
Type: New Feature New Feature
Status: Resolved Resolved
Resolution: Fixed
Priority: Major Major
Assignee: Grant Ingersoll
Reporter: Karl Wettin
Votes: 1
Watchers: 4
Operations

If you were logged in you would be able to see more operations.
Lucene - Java

InstantiatedIndex - faster but memory consuming index

Created: 20/Apr/06 12:46 PM   Updated: 13/Mar/08 12:33 PM
Return to search
Component/s: Store
Affects Version/s: 2.0.0
Fix Version/s: None

Time Tracking:
Not Specified

File Attachments:
  Size
Java Source File Licensed for inclusion in ASF works BinarySearchUtils.Apache.java 2008-02-25 06:38 PM Olivier Chafik 10 kB
Text File Licensed for inclusion in ASF works LUCENE-550.patch 2008-03-09 04:44 AM Karl Wettin 113 kB
Text File Licensed for inclusion in ASF works LUCENE-550.patch 2008-03-09 03:09 AM Karl Wettin 112 kB
Text File Licensed for inclusion in ASF works LUCENE-550.patch 2008-03-08 11:36 PM Grant Ingersoll 112 kB
Text File Licensed for inclusion in ASF works LUCENE-550_20071021_no_core_changes.txt 2007-10-21 03:44 PM Karl Wettin 109 kB
Zip Archive Licensed for inclusion in ASF works test-reports.zip 2007-01-15 09:31 AM Hoss Man 90 kB
Image Attachments:

1. classdiagram.png
(61 kB)

2. HitCollectionBench.jpg
(156 kB)
Issue Links:
Incorporates
 

Lucene Fields: Patch Available
Resolution Date: 13/Mar/08 12:33 PM


 Description  « Hide
Represented as a coupled graph of class instances, this all-in-memory index store implementation delivers search results up to a 100 times faster than the file-centric RAMDirectory at the cost of greater RAM consumption.

Performance seems to be a little bit better than log2n (binary search). No real data on that, just my eyes.

Populated with a single document InstantiatedIndex is almost, but not quite, as fast as MemoryIndex.

At 20,000 document 10-50 characters long InstantiatedIndex outperforms RAMDirectory some 30x,
15x at 100 documents of 2000 charachters length,
and is linear to RAMDirectory at 10,000 documents of 2000 characters length.

Mileage may vary depending on term saturation.



 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
No work has yet been logged on this issue.