Lucene - Core
  1. Lucene - Core
  2. LUCENE-550

InstantiatedIndex - faster but memory consuming index

    Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0
    • Fix Version/s: None
    • Component/s: core/store
    • Labels:
      None
    • Lucene Fields:
      Patch Available

      Description

      Represented as a coupled graph of class instances, this all-in-memory index store implementation delivers search results up to a 100 times faster than the file-centric RAMDirectory at the cost of greater RAM consumption.

      Performance seems to be a little bit better than log2n (binary search). No real data on that, just my eyes.

      Populated with a single document InstantiatedIndex is almost, but not quite, as fast as MemoryIndex.

      At 20,000 document 10-50 characters long InstantiatedIndex outperforms RAMDirectory some 30x,
      15x at 100 documents of 2000 charachters length,
      and is linear to RAMDirectory at 10,000 documents of 2000 characters length.

      Mileage may vary depending on term saturation.

      1. test-reports.zip
        90 kB
        Hoss Man
      2. HitCollectionBench.jpg
        156 kB
        Karl Wettin
      3. LUCENE-550_20071021_no_core_changes.txt
        109 kB
        Karl Wettin
      4. BinarySearchUtils.Apache.java
        10 kB
        Olivier Chafik
      5. LUCENE-550.patch
        112 kB
        Grant Ingersoll
      6. LUCENE-550.patch
        112 kB
        Karl Wettin
      7. classdiagram.png
        61 kB
        Karl Wettin
      8. LUCENE-550.patch
        113 kB
        Karl Wettin

        Issue Links

          Activity

            People

            • Assignee:
              Grant Ingersoll
              Reporter:
              Karl Wettin
            • Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development