[DATAFU-88] Port Stanford Core NLP Functionality to DataFu

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Won't Do
• Labels: lemmatizer nlp pig pig_udf stanford stemmer
• Assignee: Unassigned
• Reporter: Russell Jurney
• Created: 04/Feb/15 21:56
• Updated: 19/Mar/18 16:28
• Resolved: 19/Mar/18 16:28

Description

For starters I need the Stanford Core NLP stemmer and lemmatizer.

It looks like maybe I can add something generic and feed arguments to code like: props.put("annotators", "tokenize, ssplit, pos, lemma");

Helpful example of lemmatizing at http://stackoverflow.com/questions/1578062/lemmatization-java