Issue Details (XML | Word | Printable)

Key: LUCENE-550
Type: New Feature New Feature
Status: Resolved Resolved
Resolution: Fixed
Priority: Major Major
Assignee: Grant Ingersoll
Reporter: Karl Wettin
Votes: 1
Watchers: 4
Operations

If you were logged in you would be able to see more operations.
Lucene - Java

InstantiatedIndex - faster but memory consuming index

Created: 20/Apr/06 12:46 PM   Updated: 13/Mar/08 12:33 PM
Return to search
Component/s: Store
Affects Version/s: 2.0.0
Fix Version/s: None

Time Tracking:
Not Specified

File Attachments:
  Size
Java Source File Licensed for inclusion in ASF works BinarySearchUtils.Apache.java 2008-02-25 06:38 PM Olivier Chafik 10 kB
Text File Licensed for inclusion in ASF works LUCENE-550.patch 2008-03-09 04:44 AM Karl Wettin 113 kB
Text File Licensed for inclusion in ASF works LUCENE-550.patch 2008-03-09 03:09 AM Karl Wettin 112 kB
Text File Licensed for inclusion in ASF works LUCENE-550.patch 2008-03-08 11:36 PM Grant Ingersoll 112 kB
Text File Licensed for inclusion in ASF works LUCENE-550_20071021_no_core_changes.txt 2007-10-21 03:44 PM Karl Wettin 109 kB
Zip Archive Licensed for inclusion in ASF works test-reports.zip 2007-01-15 09:31 AM Hoss Man 90 kB
Image Attachments:

1. classdiagram.png
(61 kB)

2. HitCollectionBench.jpg
(156 kB)
Issue Links:
Incorporates
 

Lucene Fields: Patch Available
Resolution Date: 13/Mar/08 12:33 PM


 Description  « Hide
Represented as a coupled graph of class instances, this all-in-memory index store implementation delivers search results up to a 100 times faster than the file-centric RAMDirectory at the cost of greater RAM consumption.

Performance seems to be a little bit better than log2n (binary search). No real data on that, just my eyes.

Populated with a single document InstantiatedIndex is almost, but not quite, as fast as MemoryIndex.

At 20,000 document 10-50 characters long InstantiatedIndex outperforms RAMDirectory some 30x,
15x at 100 documents of 2000 charachters length,
and is linear to RAMDirectory at 10,000 documents of 2000 characters length.

Mileage may vary depending on term saturation.



 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
Repository Revision Date User Message
ASF #636745 Thu Mar 13 12:34:30 UTC 2008 gsingers LUCENE-550: Added RAMDirectory alternative as a contrib. Similar to MemoryIndex, but can hold more than one document
Files Changed
ADD /lucene/java/trunk/contrib/instantiated/build.xml
ADD /lucene/java/trunk/contrib/instantiated/pom.xml.template
ADD /lucene/java/trunk/contrib/instantiated/src/java/org/apache/lucene/store/instantiated/InstantiatedTermDocumentInformation.java
ADD /lucene/java/trunk/contrib/instantiated/src/java/org/apache/lucene/store/instantiated/InstantiatedTermFreqVector.java
ADD /lucene/java/trunk/contrib/instantiated/src/java/org/apache/lucene/store/instantiated
ADD /lucene/java/trunk/contrib/instantiated/docs/classdiagram.uxf
ADD /lucene/java/trunk/contrib/instantiated/src/java/org/apache/lucene/store/instantiated/InstantiatedTermPositions.java
ADD /lucene/java/trunk/contrib/instantiated/src
ADD /lucene/java/trunk/contrib/instantiated/src/test
ADD /lucene/java/trunk/contrib/instantiated/docs/classdiagram.png
ADD /lucene/java/trunk/contrib/instantiated/src/java/org/apache/lucene/store/instantiated/InstantiatedDocument.java
ADD /lucene/java/trunk/contrib/instantiated/src/java/org/apache/lucene/store/instantiated/InstantiatedIndexReader.java
ADD /lucene/java/trunk/contrib/instantiated/src/test/org/apache/lucene
ADD /lucene/java/trunk/contrib/instantiated/src/java/org/apache/lucene/store/instantiated/InstantiatedIndex.java
MODIFY /lucene/java/trunk/CHANGES.txt
ADD /lucene/java/trunk/contrib/instantiated/src/test/org/apache/lucene/store/instantiated
ADD /lucene/java/trunk/contrib/instantiated/src/java
ADD /lucene/java/trunk/contrib/instantiated/src/java/org/apache
ADD /lucene/java/trunk/contrib/instantiated/src/java/org/apache/lucene/store/instantiated/InstantiatedTermEnum.java
ADD /lucene/java/trunk/contrib/instantiated/src/java/org/apache/lucene/store/instantiated/InstantiatedTerm.java
ADD /lucene/java/trunk/contrib/instantiated/src/test/org
ADD /lucene/java/trunk/contrib/instantiated/src/java/org/apache/lucene/store/instantiated/InstantiatedIndexWriter.java
ADD /lucene/java/trunk/contrib/instantiated/src/java/org/apache/lucene
ADD /lucene/java/trunk/contrib/instantiated/src/java/org/apache/lucene/store/instantiated/InstantiatedTermDocs.java
ADD /lucene/java/trunk/contrib/instantiated/src/test/org/apache/lucene/store
ADD /lucene/java/trunk/contrib/instantiated/src/test/org/apache/lucene/store/instantiated/TestIndicesEquals.java
ADD /lucene/java/trunk/contrib/instantiated/docs
ADD /lucene/java/trunk/contrib/instantiated/src/test/org/apache
ADD /lucene/java/trunk/contrib/instantiated/src/java/org/apache/lucene/store/instantiated/package.html
ADD /lucene/java/trunk/contrib/instantiated/src/java/org
ADD /lucene/java/trunk/contrib/instantiated
ADD /lucene/java/trunk/contrib/instantiated/src/java/org/apache/lucene/store/instantiated/InstantiatedTermPositionVector.java
ADD /lucene/java/trunk/contrib/instantiated/src/java/org/apache/lucene/store

Repository Revision Date User Message
ASF #636749 Thu Mar 13 13:00:03 UTC 2008 gsingers LUCENE-550: put the comment in the wrong spot
Files Changed
MODIFY /lucene/java/trunk/CHANGES.txt