Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-6617

Reduce FST's ram usage

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 5.3, 6.0
    • None
    • None
    • New

    Description

      Spinoff from LUCENE-6199, pulling out just the FST RAM reduction changes.

      The FST data structure tries to be a RAM efficient representation of a sorted map, but there are a few things I think we can do to trim it even more:

      • Don't store arc and node count: this is available from the Builder if you really want to do something with it.
      • Don't use the "paged" byte store unless the FST is huge; just use a single byte[]
      • Some members like lastFrozenNode, reusedBytesPerArc, allowArrayArcs are only used during building, so we should move them to the Builder
      • We don't need to cache NO_OUTPUT: we can ask the Outputs impl for it

      Attachments

        1. LUCENE-6617.patch
          35 kB
          Michael McCandless

        Activity

          People

            mikemccand Michael McCandless
            mikemccand Michael McCandless
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: