Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-15064

Locale support in StopWordsRemover

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0
    • Fix Version/s: 2.4.0
    • Component/s: ML
    • Labels:
      None

      Description

      We support case insensitive filtering (default) in StopWordsRemover. However, case insensitive matching depends on the locale and region, which cannot be explicitly set in StopWordsRemover. We should consider adding this support in MLlib.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              mengxr Xiangrui Meng
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: