Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-740

Bugs in contrib/snowball/.../SnowballProgram.java -> Kraaij-Pohlmann gives Index-OOB Exception

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Won't Fix
    • Affects Version/s: 1.9
    • Fix Version/s: None
    • Component/s: modules/analysis
    • Labels:
      None
    • Environment:

      linux amd64

    • Lucene Fields:
      New, Patch Available

      Description

      (copied from mail to java-user)
      while playing with the various stemmers of Lucene(-1.9.1), I got an
      index out of bounds exception:

      lucene-1.9.1>java -cp
      build/contrib/snowball/lucene-snowball-1.9.2-dev.jar
      net.sf.snowball.TestApp Kp bla.txt
      Exception in thread "main" java.lang.reflect.InvocationTargetException
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:64)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:615)
      at net.sf.snowball.TestApp.main(TestApp.java:56)
      Caused by: java.lang.StringIndexOutOfBoundsException: String index out
      of range: 11
      at java.lang.StringBuffer.charAt(StringBuffer.java:303)
      at net.sf.snowball.SnowballProgram.find_among_b(SnowballProgram.java:270)
      at net.sf.snowball.ext.KpStemmer.r_Step_4(KpStemmer.java:1122)
      at net.sf.snowball.ext.KpStemmer.stem(KpStemmer.java:1997)

      This happens when executing
      lucene-1.9.1>java -cp
      build/contrib/snowball/lucene-snowball-1.9.2-dev.jar
      net.sf.snowball.TestApp Kp bla.txt

      bla.txt contains just this word: 'spijsvertering'.

      After some debugging, and some tests with the original snowball
      distribution from snowball.tartarus.org, it seems that the attached
      change is needed to avoid the exception.
      (The change comes from tartarus' SnowballProgram.java)

        Attachments

        1. lucene-1.9.1-SnowballProgram.java
          1 kB
          Andreas Kohn
        2. snowball.patch.txt
          296 kB
          Doron Cohen
        3. 740-license.txt
          2 kB
          Steven Parkes

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                ankon Andreas Kohn
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: