[LUCENE-3456] Analysis Consumers should end and close any TokenStreams

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Lucene Fields: New
• Assignee: Unassigned
• Reporter: Chris Male
• Created: 25/Sep/11 08:49
• Updated: 30/Jan/13 00:30

Description

While converting consumers over to using reusableTokenStream, I notice many don't call end() or close() on TokenStreams.

Even if they are test TSs only created once, we should follow the defined usage pattern.