Lucene - Core
  1. Lucene - Core
  2. LUCENE-3026

smartcn analyzer throw NullPointer exception when the length of analysed text over 32767

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 3.1, 4.0-ALPHA
    • Fix Version/s: 3.2, 4.0-ALPHA
    • Component/s: modules/analysis
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      That's all because of org.apache.lucene.analysis.cn.smart.hhmm.SegGraph's makeIndex() method:
      public List<SegToken> makeIndex() {
      List<SegToken> result = new ArrayList<SegToken>();
      int s = -1, count = 0, size = tokenListTable.size();
      List<SegToken> tokenList;
      short index = 0;
      while (count < size) {
      if (isStartExist(s)) {
      tokenList = tokenListTable.get(s);
      for (SegToken st : tokenList)

      { st.index = index; result.add(st); index++; }

      count++;
      }
      s++;
      }
      return result;
      }

      here 'short index = 0;' should be 'int index = 0;'. And that's reported here http://code.google.com/p/imdict-chinese-analyzer/issues/detail?id=2 and http://code.google.com/p/imdict-chinese-analyzer/issues/detail?id=11, the author XiaoPingGao have already fixed this bug:http://code.google.com/p/imdict-chinese-analyzer/source/browse/trunk/src/org/apache/lucene/analysis/cn/smart/hhmm/SegGraph.java

      1. LUCENE-3026.patch
        0.7 kB
        wangzhenghang

        Activity

        Hide
        Robert Muir added a comment -

        This sounds like a bug, do you want to try your hand at contributing a patch?

        See http://wiki.apache.org/lucene-java/HowToContribute for some instructions.

        Show
        Robert Muir added a comment - This sounds like a bug, do you want to try your hand at contributing a patch? See http://wiki.apache.org/lucene-java/HowToContribute for some instructions.
        Hide
        wangzhenghang added a comment -

        It's done

        Show
        wangzhenghang added a comment - It's done
        Hide
        Robert Muir added a comment -

        Committed revision 1092328, 1092338 (branch_3x).

        Thank you for the patch!

        Show
        Robert Muir added a comment - Committed revision 1092328, 1092338 (branch_3x). Thank you for the patch!
        Hide
        Robert Muir added a comment -

        Bulk closing for 3.2

        Show
        Robert Muir added a comment - Bulk closing for 3.2

          People

          • Assignee:
            Robert Muir
            Reporter:
            wangzhenghang
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development