Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-15882

Discuss distributed linear algebra in spark.ml package

    XMLWordPrintableJSON

Details

    • Brainstorming
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • None
    • None
    • ML

    Description

      This JIRA is for discussing how org.apache.spark.mllib.linalg.distributed.* should be migrated to org.apache.spark.ml.

      Initial questions:

      • Should we use Datasets or RDDs underneath?
      • If Datasets, are there missing features needed for the migration?
      • Do we want to redesign any aspects of the distributed matrices during this move?

      Attachments

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. SPARK-6442 MLlib Local Linear Algebra Package

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-15575 Remove breeze from dependencies?

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              josephkb Joseph K. Bradley
              Votes:
              4 Vote for this issue
              Watchers:
              23 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: