Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-550

InstantiatedIndex - faster but memory consuming index

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.0.0
    • None
    • core/store
    • None
    • Patch Available

    Description

      Represented as a coupled graph of class instances, this all-in-memory index store implementation delivers search results up to a 100 times faster than the file-centric RAMDirectory at the cost of greater RAM consumption.

      Performance seems to be a little bit better than log2n (binary search). No real data on that, just my eyes.

      Populated with a single document InstantiatedIndex is almost, but not quite, as fast as MemoryIndex.

      At 20,000 document 10-50 characters long InstantiatedIndex outperforms RAMDirectory some 30x,
      15x at 100 documents of 2000 charachters length,
      and is linear to RAMDirectory at 10,000 documents of 2000 characters length.

      Mileage may vary depending on term saturation.

      Attachments

        1. test-reports.zip
          90 kB
          Chris M. Hostetter
        2. LUCENE-550.patch
          112 kB
          Grant Ingersoll
        3. LUCENE-550.patch
          112 kB
          Karl Wettin
        4. LUCENE-550.patch
          113 kB
          Karl Wettin
        5. LUCENE-550_20071021_no_core_changes.txt
          109 kB
          Karl Wettin
        6. HitCollectionBench.jpg
          156 kB
          Karl Wettin
        7. classdiagram.png
          61 kB
          Karl Wettin
        8. BinarySearchUtils.Apache.java
          10 kB
          Olivier Chafik

        Issue Links

          Activity

            People

              gsingers Grant Ingersoll
              karl.wettin Karl Wettin
              Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: