Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-550

InstantiatedIndex - faster but memory consuming index

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0
    • Fix Version/s: None
    • Component/s: core/store
    • Labels:
      None
    • Lucene Fields:
      Patch Available

      Description

      Represented as a coupled graph of class instances, this all-in-memory index store implementation delivers search results up to a 100 times faster than the file-centric RAMDirectory at the cost of greater RAM consumption.

      Performance seems to be a little bit better than log2n (binary search). No real data on that, just my eyes.

      Populated with a single document InstantiatedIndex is almost, but not quite, as fast as MemoryIndex.

      At 20,000 document 10-50 characters long InstantiatedIndex outperforms RAMDirectory some 30x,
      15x at 100 documents of 2000 charachters length,
      and is linear to RAMDirectory at 10,000 documents of 2000 characters length.

      Mileage may vary depending on term saturation.

        Attachments

        1. LUCENE-550.patch
          113 kB
          Karl Wettin
        2. classdiagram.png
          61 kB
          Karl Wettin
        3. LUCENE-550.patch
          112 kB
          Karl Wettin
        4. LUCENE-550.patch
          112 kB
          Grant Ingersoll
        5. BinarySearchUtils.Apache.java
          10 kB
          Olivier Chafik
        6. LUCENE-550_20071021_no_core_changes.txt
          109 kB
          Karl Wettin
        7. HitCollectionBench.jpg
          156 kB
          Karl Wettin
        8. test-reports.zip
          90 kB
          Hoss Man

          Issue Links

            Activity

              People

              • Assignee:
                gsingers Grant Ingersoll
                Reporter:
                karl.wettin Karl Wettin
              • Votes:
                1 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: