[SPARK-8703] Add CountVectorizer as a ml transformer to convert document to words count vector

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: ML
• Target Version/s: 1.5.0
• Assignee: yuhao yang
• Reporter: yuhao yang
• Shepherd: Joseph K. Bradley
• Created: 29/Jun/15 11:50
• Updated: 12/Aug/15 20:25
• Resolved: 09/Jul/15 17:26

Description

Converts a text document to a sparse vector of token counts. Similar to http://scikit-learn.org/stable/modules/generated/sklearn.feature_extraction.text.CountVectorizer.html

I can further add an estimator to extract vocabulary from corpus if that's appropriate.

Issue Links

• relates to: SPARK-9890 User guide for CountVectorizer
• links to: [Github] Pull Request #7084 (hhbyyh)