Solr
  1. Solr
  2. SOLR-2188

StandardTokenizerFactory should accept a maxTokenLength parameter

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 3.1, 4.0-ALPHA
    • Fix Version/s: 3.1, 4.0-ALPHA
    • Component/s: Schema and Analysis
    • Labels:
      None

      Description

      StandardTokenizer.setMaxTokenLength(int) is not exposed by StandardTokenizerFactory, but should be.

      From this solr-user email: http://www.lucidimagination.com/search/document/c31fde9a1dad7360/how_to_index_long_words_with_standardtokenizerfactory

      1. SOLR-2188.patch
        7 kB
        Steve Rowe
      2. SOLR-2188.patch
        8 kB
        Steve Rowe

        Activity

        Hide
        Steve Rowe added a comment -

        ClassicTokenizerFactory should also accept a maxTokenLength parameter.

        Show
        Steve Rowe added a comment - ClassicTokenizerFactory should also accept a maxTokenLength parameter.
        Hide
        Steve Rowe added a comment -

        UAX29URLEmailTokenizerFactory should also accept a maxTokenLength parameter.

        Show
        Steve Rowe added a comment - UAX29URLEmailTokenizerFactory should also accept a maxTokenLength parameter.
        Hide
        Steve Rowe added a comment -

        Patch adding "maxTokenLength" argument to Solr factories for StandardTokenizer, ClassicTokenizer, and UAX29URLEmailTokenizer, along with simple tests for this functionality.

        All tests pass.

        Show
        Steve Rowe added a comment - Patch adding "maxTokenLength" argument to Solr factories for StandardTokenizer, ClassicTokenizer, and UAX29URLEmailTokenizer, along with simple tests for this functionality. All tests pass.
        Hide
        Steve Rowe added a comment -

        This patch adds an entry to solr/CHANGES.txt.

        Committing shortly.

        Show
        Steve Rowe added a comment - This patch adds an entry to solr/CHANGES.txt . Committing shortly.
        Hide
        Steve Rowe added a comment -

        Committed: trunk revision 1049693, branch_3x revision 1049704

        Show
        Steve Rowe added a comment - Committed: trunk revision 1049693, branch_3x revision 1049704
        Hide
        Grant Ingersoll added a comment -

        Bulk close for 3.1.0 release

        Show
        Grant Ingersoll added a comment - Bulk close for 3.1.0 release

          People

          • Assignee:
            Steve Rowe
            Reporter:
            Steve Rowe
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development