[OPENNLP-715] Clark clusters NameFinder features

• Type: New Feature
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.6.0
• Fix Version/s: 1.6.0
• Component/s: Name Finder
• Assignee: Rodrigo Agerri
• Reporter: Rodrigo Agerri
• Created: 03/Oct/14 11:43
• Updated: 09/Mar/15 21:20
• Resolved: 09/Mar/15 13:57

Description

Add token based features from Clark clusters (Clark 2003). This feature is actually the same as the one implemented in the WordClusterFeatureGenerator, but we should somehow make them separate (perhaps implementing a dynamic prefix id for each one, as in the dictionary features) as it has been shown that the combination of these clustering-based features improve results.

Clark clusters can be generated using this tool:

https://github.com/ninjin/clark_pos_induction