Solr
  1. Solr
  2. SOLR-1192

solr.NGramFilterFactory stops to index the content if it find a token smaller than minim ngram size

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.3
    • Fix Version/s: 1.4
    • Component/s: Schema and Analysis
    • Labels:
      None
    • Environment:

      any

      Description

      If a field is split in tokens (by a tokenizer) and after that is aplied the NGramFilterFactory for these tokens...the indexing goes well while the length of the tokens is greater or equal with minim ngram size (ussually is 3). Otherwise the indexing breaks in this point and the rest of tokens are no more indexed. This behaviour can be easy observed with the analysis tool which is in Solr admin interface.

        Issue Links

          Activity

          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Resolved Resolved
          48d 2h 25m 1 Otis Gospodnetic 15/Jul/09 21:38
          Resolved Resolved Closed Closed
          117d 19h 13m 1 Grant Ingersoll 10/Nov/09 15:52
          Gavin made changes -
          Link This issue depends upon LUCENE-1491 [ LUCENE-1491 ]
          Gavin made changes -
          Link This issue depends on LUCENE-1491 [ LUCENE-1491 ]
          Grant Ingersoll made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Hide
          Grant Ingersoll added a comment -

          Bulk close for Solr 1.4

          Show
          Grant Ingersoll added a comment - Bulk close for Solr 1.4
          Otis Gospodnetic made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Hide
          Otis Gospodnetic added a comment -

          Should be taken care of with Lucene upgrade now.

          Show
          Otis Gospodnetic added a comment - Should be taken care of with Lucene upgrade now.
          Hide
          Shalin Shekhar Mangar added a comment -

          Lucene has been upgraded in trunk, so we can mark this as fixed.

          Show
          Shalin Shekhar Mangar added a comment - Lucene has been upgraded in trunk, so we can mark this as fixed.
          Hide
          Otis Gospodnetic added a comment -

          LUCENE-1491 fix is in Lucene repository now, so as soon as we pull new Lucene jars into Solr, I'll mark this as fixed. Feel free to test with local copies of the Lucene nightly jars tomorrow and report back.

          Show
          Otis Gospodnetic added a comment - LUCENE-1491 fix is in Lucene repository now, so as soon as we pull new Lucene jars into Solr, I'll mark this as fixed. Feel free to test with local copies of the Lucene nightly jars tomorrow and report back.
          Hoss Man made changes -
          Assignee Otis Gospodnetic [ otis ]
          Hide
          Hoss Man added a comment -

          depends on LUCENE issue assigned to otis, so giving this to otis as well.

          (allthough unless Otis decides to add a new option to the underlying filter in LUCENE-1491, fixing this issue should be a NOOP).

          Show
          Hoss Man added a comment - depends on LUCENE issue assigned to otis, so giving this to otis as well. (allthough unless Otis decides to add a new option to the underlying filter in LUCENE-1491 , fixing this issue should be a NOOP).
          Otis Gospodnetic made changes -
          Fix Version/s 1.4 [ 12313351 ]
          Fix Version/s 1.3 [ 12312486 ]
          Otis Gospodnetic made changes -
          Field Original Value New Value
          Link This issue depends on LUCENE-1491 [ LUCENE-1491 ]
          Hide
          Otis Gospodnetic added a comment -

          That stems from Lucene, see LUCENE-1491.

          Show
          Otis Gospodnetic added a comment - That stems from Lucene, see LUCENE-1491 .
          viobade created issue -

            People

            • Assignee:
              Otis Gospodnetic
              Reporter:
              viobade
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development