Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-12869

Optimize conversion from BlockMatrix to IndexedRowMatrix

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.6.0
    • 2.0.0
    • MLlib
    • None

    Description

      In the current implementation of the BlockMatrix, the conversion to the IndexedRowMatrix is done by converting it to a CoordinateMatrix first. This is somewhat ok when the matrix is very sparse, but for dense matrices this is very inefficient.

      Attachments

        Issue Links

          Activity

            People

              fokko Fokko Driesprong
              fokko Fokko Driesprong
              Xiangrui Meng Xiangrui Meng
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 48h
                  48h
                  Remaining:
                  Remaining Estimate - 48h
                  48h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified