[LUCENE-4642] Add create(AttributeFactory) to TokenizerFactory and subclasses with ctors taking AttributeFactory, and remove Tokenizer's and subclasses' ctors taking AttributeSource

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.1
• Fix Version/s: 4.3, 6.0
• Component/s: modules/analysis
• Labels: analysis attribute tokenizer
• Lucene Fields: New, Patch Available
• Assignee: Steven Rowe
• Reporter: Renaud Delbru
• Created: 20/Dec/12 15:04
• Updated: 28/Aug/22 13:35
• Resolved: 15/Mar/13 05:33

Description

All tokenizer implementations have a constructor that takes a given AttributeSource as parameter (LUCENE-1826). These should be removed.

TokenizerFactory does not provide an API to create tokenizers with a given AttributeFactory, but quite a few tokenizers have constructors that take an AttributeFactory. TokenizerFactory should add a create(AttributeFactory) method, as should subclasses for tokenizers with AttributeFactory accepting ctors.