Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.4, 4.0-ALPHA
    • Component/s: None
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      The current synonymsfilter uses a lot of ram and cpu, especially at build time.

      I think yesterday I heard about "huge synonyms files" three times.

      So, I think we should use an FST-based structure, sharing the inputs and outputs.
      And we should be more efficient with the tokenStream api, e.g. using save/restoreState instead of cloneAttributes()

      1. LUCENE-3223.patch
        29 kB
        Michael McCandless
      2. LUCENE-3233.patch
        248 kB
        Michael McCandless
      3. LUCENE-3233.patch
        252 kB
        Robert Muir
      4. LUCENE-3233.patch
        252 kB
        Robert Muir
      5. LUCENE-3233.patch
        94 kB
        Michael McCandless
      6. LUCENE-3233.patch
        91 kB
        Michael McCandless
      7. LUCENE-3233.patch
        95 kB
        Robert Muir
      8. LUCENE-3233.patch
        89 kB
        Michael McCandless
      9. LUCENE-3233.patch
        83 kB
        Robert Muir
      10. LUCENE-3233.patch
        80 kB
        Robert Muir
      11. LUCENE-3233.patch
        78 kB
        Robert Muir
      12. LUCENE-3233.patch
        73 kB
        Robert Muir
      13. LUCENE-3233.patch
        54 kB
        Michael McCandless
      14. LUCENE-3233.patch
        52 kB
        Michael McCandless
      15. LUCENE-3233.patch
        44 kB
        Robert Muir
      16. LUCENE-3233.patch
        48 kB
        Michael McCandless
      17. LUCENE-3233.patch
        16 kB
        Robert Muir
      18. synonyms.zip
        575 kB
        Robert Muir

        Issue Links

          Activity

          Robert Muir created issue -
          Robert Muir made changes -
          Field Original Value New Value
          Attachment LUCENE-3233.patch [ 12483597 ]
          Michael McCandless made changes -
          Attachment LUCENE-3223.patch [ 12483689 ]
          Michael McCandless made changes -
          Attachment LUCENE-3233.patch [ 12485170 ]
          Robert Muir made changes -
          Attachment LUCENE-3233.patch [ 12485276 ]
          Michael McCandless made changes -
          Attachment LUCENE-3233.patch [ 12485316 ]
          Michael McCandless made changes -
          Attachment LUCENE-3233.patch [ 12485341 ]
          Robert Muir made changes -
          Attachment LUCENE-3233.patch [ 12485371 ]
          Robert Muir made changes -
          Attachment LUCENE-3233.patch [ 12485377 ]
          Robert Muir made changes -
          Attachment synonyms.zip [ 12485378 ]
          Robert Muir made changes -
          Attachment LUCENE-3233.patch [ 12485452 ]
          Robert Muir made changes -
          Attachment LUCENE-3233.patch [ 12485476 ]
          Michael McCandless made changes -
          Attachment LUCENE-3233.patch [ 12485488 ]
          Robert Muir made changes -
          Attachment LUCENE-3233.patch [ 12485522 ]
          Michael McCandless made changes -
          Attachment LUCENE-3233.patch [ 12485583 ]
          Michael McCandless made changes -
          Attachment LUCENE-3233.patch [ 12485642 ]
          Robert Muir made changes -
          Attachment LUCENE-3233.patch [ 12485966 ]
          Robert Muir made changes -
          Attachment LUCENE-3233.patch [ 12485989 ]
          Michael McCandless made changes -
          Attachment LUCENE-3233.patch [ 12486007 ]
          Robert Muir made changes -
          Assignee Robert Muir [ rcmuir ]
          Robert Muir made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Fix Version/s 3.4 [ 12316675 ]
          Fix Version/s 4.0 [ 12314025 ]
          Resolution Fixed [ 1 ]
          Yonik Seeley made changes -
          Resolution Fixed [ 1 ]
          Status Resolved [ 5 ] Reopened [ 4 ]
          Assignee Robert Muir [ rcmuir ]
          Yonik Seeley made changes -
          Status Reopened [ 4 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Uwe Schindler made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Steve Rowe made changes -
          Link This issue is duplicated by SOLR-2628 [ SOLR-2628 ]
          Hoss Man made changes -
          Link This issue supercedes LUCENE-2347 [ LUCENE-2347 ]

            People

            • Assignee:
              Unassigned
              Reporter:
              Robert Muir
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development