[OPENNLP-415] NameFinder Dictionary Search Not Working Correctly

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: tools-1.5.1-incubating, tools-1.5.2-incubating
• Fix Version/s: tools-1.5.3
• Component/s: Name Finder
• Labels: case dictionary sensitivity
• Assignee: James Kosin
• Reporter: James Kosin
• Created: 21/Dec/11 04:30
• Updated: 21/Dec/11 05:27
• Resolved: 21/Dec/11 05:26

Description

With a case_sensitive="false" dictionary, the DictionaryNameFinder wrongly doesn't find the correct name.

Thanks to Loic Descotte for finding this bug.

A Dictionary containing "tamato" and a sentence containing "Tamato" does not correctly find the name.

The bug was traced to a reworked MetaDictionary that tries to filter the sentece tokens based on presence in the dictionary. This new dictionary however is case sensitive.