[LUCENE-4279] Regenerate Snowball code so its not so heavy

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0-BETA, 6.0
• Lucene Fields: New
• Assignee: Unassigned
• Reporter: Robert Muir
• Created: 01/Aug/12 16:27
• Updated: 28/Aug/22 13:23
• Resolved: 01/Aug/12 18:59

Description

Spinoff from LUCENE-3841 (and several threads on the list)

Currently each SnowballStemmer is pretty heavy since each instance also contains a bunch of Among objects (part of the stemming rules).

This normally shouldnt be a problem, except it seems challenging
for tomcat users to tune their threadpools (basically they are creating
lots of tokenstreams, so lots of SnowballStemmers)

Newer snowball just makes these static, and its easy enough to just
regenerate so these aren't so heavy, it doesnt fix the real problem but it also doesn't hurt.