Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-594

StopFilterFactory, SynonymFilterFactory and EnglishProterFilterFactory not backwards compatible because of inform



    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Won't Fix
    • Affects Version/s: 1.3
    • Fix Version/s: 1.3
    • Component/s: None
    • Labels:


      Direct construction of StopWordFilter is not backwards compatible between 1.2 and 1.3. Here is some test code that throws a null pointer exception in 1.3 but that functions correctly in 1.2.

      TokenizerFactory tokenizer = new WhitespaceTokenizerFactory();

      Map<String, String> args = new HashMap<String, String>();
      args.put("ignoreCase", "true");
      args.put("words", "stopwords.txt");
      StopFilterFactory stopFilter = new StopFilterFactory();

      args = new HashMap<String, String>();
      args.put("generateWordParts", "1");
      args.put("generateNumberParts", "1");
      args.put("catenateWords", "0");
      args.put("catenateNumbers", "0");
      args.put("catenateAll", "0");
      WordDelimiterFilterFactory wordFilter = new WordDelimiterFilterFactory();

      TokenFilterFactory[] filters = new TokenFilterFactory[]

      {stopFilter, wordFilter }

      TokenizerChain pipeline =TokenizerChain(tokenizer, filters);

      /*** throws a null pointer exception in 1.3: ***/
      boolean onlyStopWords = pipeline.tokenStream(null, new StringReader(query)).next() == null;

      Hoss commented thusly in the solr forums (including a workaround):

      The short answer is: right after you call "stopFilter.init(args)" call

      This is an interesting use case that wasn't really considered when we
      switched away from using hte SolrCore singlton and the the
      ResourceLoaderAware interface was added. we made sure things would still
      work for people who had their own custom Analysis Factories, but some of
      the functionality in existing Factories was moved from the init() method
      to inform() ... which means the classes aren't technically backwards
      compatibly for people doing what you're doing: constructing them directly.

      When I have some more time, i'll spin up a thread on solr-dev to discuss
      what we should do about this – n the mean time feel free to file a bug
      that StopFilter isn't backwards compatible.


          Issue Links



              • Assignee:
                hossman Chris M. Hostetter
                ronbraun Ronald Braun
              • Votes:
                0 Vote for this issue
                0 Start watching this issue


                • Created: