[LUCENE-7003] Adding a class to help debug a TokenFilter

• Type: Improvement
• Status: Resolved
• Priority: Trivial
• Resolution: Implemented
• Component/s: modules/test-framework
• Lucene Fields: New, Patch Available
• Assignee: Unassigned
• Reporter: Jean-Baptiste Lespiau
• Created: 30/Jan/16 00:30
• Updated: 28/Aug/22 14:49
• Resolved: 26/Apr/16 21:42

Description

When debugging a TokenFilter, I need to run it on strings to see the details of the token generated.

I haven't found any class doing that, but I did found a TODO comment asking for one, so here it is.

It may already exist, or make more sense to put in in another location. Just tell me if it is the case.

Issue Links

• is required by: LUCENE-7004 Duplicate tokens using WordDelimiterFilter for a specific configuration