Solr
  1. Solr
  2. SOLR-1192

solr.NGramFilterFactory stops to index the content if it find a token smaller than minim ngram size

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.3
    • Fix Version/s: 1.4
    • Component/s: Schema and Analysis
    • Labels:
      None
    • Environment:

      any

      Description

      If a field is split in tokens (by a tokenizer) and after that is aplied the NGramFilterFactory for these tokens...the indexing goes well while the length of the tokens is greater or equal with minim ngram size (ussually is 3). Otherwise the indexing breaks in this point and the rest of tokens are no more indexed. This behaviour can be easy observed with the analysis tool which is in Solr admin interface.

        Issue Links

          Activity

          Hide
          Grant Ingersoll added a comment -

          Bulk close for Solr 1.4

          Show
          Grant Ingersoll added a comment - Bulk close for Solr 1.4
          Hide
          Otis Gospodnetic added a comment -

          Should be taken care of with Lucene upgrade now.

          Show
          Otis Gospodnetic added a comment - Should be taken care of with Lucene upgrade now.
          Hide
          Shalin Shekhar Mangar added a comment -

          Lucene has been upgraded in trunk, so we can mark this as fixed.

          Show
          Shalin Shekhar Mangar added a comment - Lucene has been upgraded in trunk, so we can mark this as fixed.
          Hide
          Otis Gospodnetic added a comment -

          LUCENE-1491 fix is in Lucene repository now, so as soon as we pull new Lucene jars into Solr, I'll mark this as fixed. Feel free to test with local copies of the Lucene nightly jars tomorrow and report back.

          Show
          Otis Gospodnetic added a comment - LUCENE-1491 fix is in Lucene repository now, so as soon as we pull new Lucene jars into Solr, I'll mark this as fixed. Feel free to test with local copies of the Lucene nightly jars tomorrow and report back.
          Hide
          Hoss Man added a comment -

          depends on LUCENE issue assigned to otis, so giving this to otis as well.

          (allthough unless Otis decides to add a new option to the underlying filter in LUCENE-1491, fixing this issue should be a NOOP).

          Show
          Hoss Man added a comment - depends on LUCENE issue assigned to otis, so giving this to otis as well. (allthough unless Otis decides to add a new option to the underlying filter in LUCENE-1491 , fixing this issue should be a NOOP).
          Hide
          Otis Gospodnetic added a comment -

          That stems from Lucene, see LUCENE-1491.

          Show
          Otis Gospodnetic added a comment - That stems from Lucene, see LUCENE-1491 .

            People

            • Assignee:
              Otis Gospodnetic
              Reporter:
              viobade
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development