[LUCENE-1077] New Analysis Contributions

• Type: New Feature
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.3
• Component/s: modules/analysis, modules/other
• Assignee: Grant Ingersoll
• Reporter: Grant Ingersoll
• Created: 04/Dec/07 16:13
• Updated: 28/Aug/22 11:43
• Resolved: 07/Dec/07 12:57

Description

With the advent of the new TeeTokenFilter and SinkTokenizer, there now exists some interesting new things that can be done in the analysis phase of indexing. See LUCENE-1058.

This patch provides some new implementations of SinkTokenizer that may be useful.