[SOLR-1398] PatternTokenizerFactory ignores offset corrections

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.4
• Fix Version/s: 1.4
• Component/s: Schema and Analysis
• Assignee: Koji Sekiguchi
• Reporter: Anders Melchiorsen
• Created: 31/Aug/09 09:45
• Updated: 10/Nov/09 15:52
• Resolved: 06/Sep/09 03:47

Description

I have an analyzer with a MappingCharFilterFactory followed by a PatternTokenizerFactory. This causes wrong offsets, and thus wrong highlights.

Replacing the tokenizer with WhitespaceTokenizerFactory gives correct offsets, so I expect the problem to be with PatternTokenizerFactory.