Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-1377

Force TokenizerFactory to create a Tokenizer rather then TokenStream

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.4
    • Schema and Analysis
    • None

    Description

      The new token reuse classes require that they are created with a Tokenizer. The solr TokenizerFactory interface currently makes a TokenStream.

      Although this is an API breaking change, the alternative is to just document that it needs to be a Tokenizer instance and throw an error when it is not.

      For more discussion, see:
      http://www.lucidimagination.com/search/document/272b8c4e6198d887/trunk_classcastexception_with_basetokenizerfactory

      Attachments

        1. SOLR-1377-Tokenizer.patch
          9 kB
          Ryan McKinley
        2. SOLR-1377.patch
          10 kB
          Yonik Seeley

        Activity

          People

            ryantxu Ryan McKinley
            ryantxu Ryan McKinley
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: