Details
-
New Feature
-
Status: Resolved
-
Trivial
-
Resolution: Won't Fix
-
None
-
None
-
None
-
New, Patch Available
Description
Alternative NGram filter that produce tokens with composite prefix and suffix markers.
ts = new WhitespaceTokenizer(new StringReader("hello")); ts = new CombinedNGramTokenFilter(ts, 2, 2); assertNext(ts, "^h"); assertNext(ts, "he"); assertNext(ts, "el"); assertNext(ts, "ll"); assertNext(ts, "lo"); assertNext(ts, "o$"); assertNull(ts.next());