[LUCENE-2384] Reset zzBuffer in StandardTokenizerImpl* when lexer is reset.

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.1
• Fix Version/s: 2.9.4, 3.0.3, 3.1, 4.0-ALPHA
• Component/s: modules/analysis
• Lucene Fields: New
• Assignee: Uwe Schindler
• Reporter: Uwe Schindler
• Created: 08/Apr/10 11:06
• Updated: 01/Dec/10 14:49
• Resolved: 29/Oct/10 13:53

Description

When indexing large documents, the lexer buffer may stay large forever. This sub-issue resets the lexer buffer back to the default on reset(Reader).

This is done on the enclosing issue.

Issue Links

• is part of: LUCENE-2074 Use a separate JFlex generated Unicode 4 by Java 5 compatible StandardTokenizer