Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-5766

Slow RowMatrix multiplication

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Not A Problem
    • None
    • None
    • MLlib

    Description

      Looking at the source code for RowMatrix multiplication by a local matrix, it seems like it is going through all columnvectors of the matrix, doing pairwise dot product on each column.
      It seems like this could be sped up by using gemm, performing full matrix-matrix multiplication on the local data, (or gemv, for vector-matrix multiplication), as is done in BlockMatrix or Matrix.

      Attachments

        Activity

          People

            Unassigned Unassigned
            amaru Amaru Cuba Gyllensten
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: