Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-18131

Support returning Vector/Dense Vector from backend

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • None
    • None
    • SparkR

    Description

      For `spark.logit`, there is a `probabilityCol`, which is a vector in the backend (scala side). When we do collect(select(df, "probabilityCol")), backend returns the java object handle (memory address). We need to implement a method to convert a Vector/Dense Vector column as R vector, which can be read in SparkR. It is a followup JIRA of adding `spark.logit`.

      Attachments

        Activity

          People

            Unassigned Unassigned
            wm624 Miao Wang
            Votes:
            1 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: