Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-5566

Tokenizer for mllib package

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.3.0
    • 1.4.0
    • ML, MLlib
    • None

    Description

      There exist tokenizer classes in the spark.ml.feature package and in the LDAExample in the spark.examples.mllib package. The Tokenizer in the LDAExample is more advanced and should be made into a full-fledged public class in spark.mllib.feature. The spark.ml.feature.Tokenizer class should become a wrapper around the new Tokenizer.

      Attachments

        Issue Links

          Activity

            People

              augustinB Augustin Borsu
              josephkb Joseph K. Bradley
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: