Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-769

[PATCH] Performance improvement for some cases of sorted search

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • 2.0.0
    • None
    • core/search
    • None
    • New, Patch Available

    Description

      It's a small addition to Lucene that significantly lowers memory consumption and improves performance for sorted searches with frequent index updates and relatively big indexes (>1mln docs) scenario. This solution supports only single-field sorting currently (which seem to be quite popular use case). Multiple fields support can be added without much trouble.

      The solution is this: documents from the sorting set (instead of given field's values from the whole index - current FieldCache approach) are cached in a WeakHashMap so the cached items are candidates for GC. Their fields values are then fetched from the cache and compared while sorting.

      Attachments

        1. selfContained.patch
          12 kB
          Artem Vasiliev

        Activity

          People

            Unassigned Unassigned
            artemv Artem Vasiliev
            Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: