[OPENNLP-760] probabilistic lemmatizer

• Type: New Feature
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.7.0
• Component/s: Lemmatizer
• Assignee: Rodrigo Agerri
• Reporter: Rodrigo Agerri
• Created: 06/Mar/15 07:53
• Updated: 21/May/16 09:57
• Resolved: 18/Feb/16 21:24

Description

Current SimpleLemmatizer is dictionary-based. A probabilistic lemmatizer works better for unknown words and can be combined with dictionaries.

The method we will implement here is based on:
Grzegorz Chrupała. 2008. Towards a Machine-Learning Architecture for Lexical Functional Grammar Parsing. PhD dissertation, Dublin City University. http://grzegorz.chrupala.me/papers/phd-single.pdf