[LUCENE-1101] TokenStream.next(Token) reuse 'policy': calling Token.clear() should be responsibility of producer.

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3
• Fix Version/s: 2.3
• Lucene Fields: New
• Assignee: Doron Cohen
• Reporter: Doron Cohen
• Created: 26/Dec/07 21:55
• Updated: 28/Aug/22 11:44
• Resolved: 30/Dec/07 07:36

Description

Tokenizers which implement the reuse form of the next method:
next(Token result)
should reset the postionIncrement of the returned token to 1.

Issue Links

• blocks: LUCENE-1095 StopFilter should have option to incr positionIncrement after stop word