Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-5174

On disk FST objects

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 4.4, 4.3.1
    • Fix Version/s: None
    • Component/s: core/FSTs
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      If one wants to support multiple language suggestions at the same time via AnalyzingSuggester/FuzzySuggester on Android, it's almost not possible for the time being, because all suggesters use in memory resident FST's. And of course each language needs its own FST. On Android there are VM memory restrictions of 32MB for older devices like the Nexus S. Making the math: a good language FST is roughly 11-15MB in size. Supporting even 2 languages at the same time is therefore difficult taking into account that FST's are not the only part of a common Android app.

      A possible approach to a solution via memory mapping and DirectByteBuffer has been proposed by Mike Mc Candless on Lucene ML:

      http://mail-archives.apache.org/mod_mbox/lucene-java-user/201308.mbox/%3CCAL8PwkbHdeEvk+e47H6v6_=Ln36yhE2RY=m7rqBFP+H50u58dQ@mail.gmail.com%3E

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              annanik Anna Björk Nikulásdóttir
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: