Lucene - Core
  1. Lucene - Core
  2. LUCENE-740

Bugs in contrib/snowball/.../SnowballProgram.java -> Kraaij-Pohlmann gives Index-OOB Exception

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Won't Fix
    • Affects Version/s: 1.9
    • Fix Version/s: None
    • Component/s: modules/analysis
    • Labels:
      None
    • Environment:

      linux amd64

    • Lucene Fields:
      New, Patch Available

      Description

      (copied from mail to java-user)
      while playing with the various stemmers of Lucene(-1.9.1), I got an
      index out of bounds exception:

      lucene-1.9.1>java -cp
      build/contrib/snowball/lucene-snowball-1.9.2-dev.jar
      net.sf.snowball.TestApp Kp bla.txt
      Exception in thread "main" java.lang.reflect.InvocationTargetException
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:64)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:615)
      at net.sf.snowball.TestApp.main(TestApp.java:56)
      Caused by: java.lang.StringIndexOutOfBoundsException: String index out
      of range: 11
      at java.lang.StringBuffer.charAt(StringBuffer.java:303)
      at net.sf.snowball.SnowballProgram.find_among_b(SnowballProgram.java:270)
      at net.sf.snowball.ext.KpStemmer.r_Step_4(KpStemmer.java:1122)
      at net.sf.snowball.ext.KpStemmer.stem(KpStemmer.java:1997)

      This happens when executing
      lucene-1.9.1>java -cp
      build/contrib/snowball/lucene-snowball-1.9.2-dev.jar
      net.sf.snowball.TestApp Kp bla.txt

      bla.txt contains just this word: 'spijsvertering'.

      After some debugging, and some tests with the original snowball
      distribution from snowball.tartarus.org, it seems that the attached
      change is needed to avoid the exception.
      (The change comes from tartarus' SnowballProgram.java)

      1. lucene-1.9.1-SnowballProgram.java
        1 kB
        Andreas Kohn
      2. snowball.patch.txt
        296 kB
        Doron Cohen
      3. 740-license.txt
        2 kB
        Steven Parkes

        Issue Links

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Andreas Kohn
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development