[LUCENE-2407] make CharTokenizer.MAX_WORD_LEN parametrizable

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.0.1
• Fix Version/s: 4.9, 6.0
• Component/s: modules/analysis
• Labels: dead
• Lucene Fields: New
• Assignee: Unassigned
• Reporter: jmwap
• Created: 21/Apr/10 14:30
• Updated: 28/Aug/22 12:24

Description

as discussed here http://n3.nabble.com/are-long-words-split-into-up-to-256-long-tokens-tp739914p739914.html it would be nice to be able to parametrize that value.