[LUCENE-3968] Factor MockGraphTokenFilter into LookaheadTokenFilter + random tokens

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 4.9, 6.0
• Lucene Fields: New
• Assignee: Michael McCandless
• Reporter: Michael McCandless
• Created: 08/Apr/12 16:28
• Updated: 28/Aug/22 13:14

Description

MockGraphTokenFilter is rather hairy... I've managed to simplify it (I think!) by breaking apart its two functions...

I think LookaheadTokenFilter can be used in the future for other graph aware filters.