[LUCENE-3896] CharTokenizer has bugs for large documents.

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 3.6, 4.0-ALPHA
• Component/s: modules/analysis
• Lucene Fields: New
• Assignee: Unassigned
• Reporter: Robert Muir
• Created: 21/Mar/12 01:33
• Updated: 28/Aug/22 13:11
• Resolved: 21/Mar/12 14:31

Description

Initially found by hudson from additional testing added in LUCENE-3894, but
currently not reproducable (see LUCENE-3895).

But its easy to reproduce for a simple single-threaded case in TestDuelingAnalyzers.