Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-7279

AIOOBE from JapaneseTokenizer

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 5.5.2, 5.6, 6.0.1, 7.0
    • modules/analysis
    • None
    • New

    Description

      On certain Japanese input strings you can hit this:

      java.lang.ArrayIndexOutOfBoundsException: -1
      	at __randomizedtesting.SeedInfo.seed([C6752A567B924B1:2B195610610ED60]:0)
      	at org.apache.lucene.analysis.ja.JapaneseTokenizer.backtrace(JapaneseTokenizer.java:1607)
      	at org.apache.lucene.analysis.ja.JapaneseTokenizer.parse(JapaneseTokenizer.java:902)
      	at org.apache.lucene.analysis.ja.JapaneseTokenizer.incrementToken(JapaneseTokenizer.java:479)
      	at org.apache.lucene.analysis.ja.TestJapaneseTokenizer.testBigDocument(TestJapaneseTokenizer.java:837)
      

      I have a patch with a test case and fix.

      Attachments

        1. LUCENE-7279.patch
          10 kB
          Michael McCandless

        Activity

          People

            mikemccand Michael McCandless
            mikemccand Michael McCandless
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: