Details

Type: New Feature

Status: Open

Priority: Critical

Resolution: Unresolved

Affects Version/s: None

Fix Version/s: None

Component/s: MLlib

Labels:None
Description
MLlib's local linear algebra package doesn't have any support for any type of matrix operations. With 1.5, we wish to add support to a complete package of optimized linear algebra operations for Scala/Java users.
The main goal is to support lazy operations so that elementwise can be implemented in a single forloop, and complex operations can be interfaced through BLAS.
The design doc: http://goo.gl/sf5LCE
Issue Links
 incorporates

SPARK9003 Add map/update function to MLlib/Vector
 In Progress
 is duplicated by

SPARK10989 Add the dot and hadamard products to the Vectors object
 Resolved
 is related to

SPARK10989 Add the dot and hadamard products to the Vectors object
 Resolved

SPARK20221 Port pyspark.mllib.linalg tests in pyspark/mllib/tests.py to pyspark.ml.linalg
 Open
 relates to

SPARK15575 Remove breeze from dependencies?
 Open

SPARK15882 Discuss distributed linear algebra in spark.ml package
 Open
The version in the comment should be updated to 1.5.