Details
-
Improvement
-
Status: Closed
-
Minor
-
Resolution: Won't Fix
-
None
-
None
-
None
Description
SparseMatrix.equals currently uses toBreeze and then calls Breeze's equals method. However, it looks like Breeze's equals is inefficient: https://github.com/scalanlp/breeze/blob/1130e0de31948d19225179d8500a8d2d1cc337d0/math/src/main/scala/breeze/linalg/Matrix.scala#L132
Breeze iterates over all values, including implicit zeros. We could make this more efficient.
Attachments
Issue Links
- is related to
-
SPARK-9750 SparseMatrix should override equals
- Resolved
- links to