Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-8457

Documentation for N-Gram feature transformer

    Details

    • Type: Documentation
    • Status: Resolved
    • Priority: Trivial
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.5.0
    • Component/s: ML
    • Labels:
      None
    • Target Version/s:

      Description

      Documentation for using n-gram feature transformer needs to be written. In particular, we need to describe the input (ArrayType(StringType)) and output (ArrayType(ArrayType(StringType)) formats, nullability constraints (input is nullable, output is not) and behaviors (null values are ignored in generating n-grams), as well as edge cases (e.g. n-gram length > input sequence length will yield a single output n-gram equal to the input sequence).

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                fliang Feynman Liang
                Reporter:
                fliang Feynman Liang
                Shepherd:
                Joseph K. Bradley
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: