Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-12191

Support "." character in DataFrame column name for ML

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • None
    • None
    • ML, SparkR

    Description

      Currently if you specify the inputCol/outputCol with names which include dot, it will throw exceptions.
      We should support "." character in DataFrame column name for ML.
      Meanwhile, we can change the SparkR mllib examples to use "Sepal.Length" rather than "Sepal_Length".

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-11977 Support accessing a DataFrame column using its name without backticks if the name contains '.'

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-21536 Remove the workaroud to allow dots in field names in R's createDataFame

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-11976 Support "." character in DataFrame column name

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              yanboliang Yanbo Liang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: