Uploaded image for project: 'Mahout'
  1. Mahout
  2. MAHOUT-2003

Check to see if CUSPARSE library requires sorted CSC format

    Details

    • Type: Test
    • Status: Resolved
    • Priority: Major
    • Resolution: Not A Problem
    • Affects Version/s: 0.13.1
    • Fix Version/s: 0.13.2
    • Component/s: None
    • Labels:
      None

      Description

      Test whether CUSPARSE requires sorted CSC(R) if not, it should be an easy win- to shave some time off of the conversion to compressed format without any sorting.

        Activity

        Hide
        Andrew_Palumbo Andrew Palumbo added a comment - - edited

        It seems that CUSPARSE cusparseDcsrgemm requires sorted CSR format.

        Testing with unsorted rows without sorting results in:

        CUDATestSuite:
        log4j:WARN No appenders could be found for logger (org.apache.mahout.math.backend.RootSolverFactory$).
        log4j:WARN Please initialize the log4j system properly.
        log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
        Mahout JVM Sparse multiplication time: 1898 ms.
        - sparse mmul at geometry of 1000 x 1000 %*% 1000 x 1000 density = .2.  5 runs *** FAILED ***
          jcuda.CudaException: cudaErrorIllegalAddress
          at jcuda.runtime.JCuda.checkResult(JCuda.java:460)
          at jcuda.runtime.JCuda.cudaMemcpy(JCuda.java:4592)
          at org.apache.mahout.cuda.package$.prod(package.scala:311)
          at org.apache.mahout.cuda.CUDATestSuite$.getAverageTimeSparse(CUDATestSuite.scala:68)
          at org.apache.mahout.cuda.CUDATestSuite$$anonfun$1.apply$mcV$sp(CUDATestSuite.scala:14)
          at org.apache.mahout.cuda.CUDATestSuite$$anonfun$1.apply(CUDATestSuite.scala:14)
          at org.apache.mahout.cuda.CUDATestSuite$$anonfun$1.apply(CUDATestSuite.scala:14)
          at org.scalatest.Transformer$$anonfun$apply$1.apply$mcV$sp(Transformer.scala:22)
          at org.scalatest.OutcomeOf$class.outcomeOf(OutcomeOf.scala:85)
          at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
          ...
        - sparse mmul at geometry of 1000 x 1000 %*% 1000 x 1000 density = .02.  5 runs *** FAILED **
        
        Show
        Andrew_Palumbo Andrew Palumbo added a comment - - edited It seems that CUSPARSE cusparseDcsrgemm requires sorted CSR format. Testing with unsorted rows without sorting results in: CUDATestSuite: log4j:WARN No appenders could be found for logger (org.apache.mahout.math.backend.RootSolverFactory$). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http: //logging.apache.org/log4j/1.2/faq.html#noconfig for more info. Mahout JVM Sparse multiplication time: 1898 ms. - sparse mmul at geometry of 1000 x 1000 %*% 1000 x 1000 density = .2. 5 runs *** FAILED *** jcuda.CudaException: cudaErrorIllegalAddress at jcuda.runtime.JCuda.checkResult(JCuda.java:460) at jcuda.runtime.JCuda.cudaMemcpy(JCuda.java:4592) at org.apache.mahout.cuda. package $.prod( package .scala:311) at org.apache.mahout.cuda.CUDATestSuite$.getAverageTimeSparse(CUDATestSuite.scala:68) at org.apache.mahout.cuda.CUDATestSuite$$anonfun$1.apply$mcV$sp(CUDATestSuite.scala:14) at org.apache.mahout.cuda.CUDATestSuite$$anonfun$1.apply(CUDATestSuite.scala:14) at org.apache.mahout.cuda.CUDATestSuite$$anonfun$1.apply(CUDATestSuite.scala:14) at org.scalatest.Transformer$$anonfun$apply$1.apply$mcV$sp(Transformer.scala:22) at org.scalatest.OutcomeOf$class.outcomeOf(OutcomeOf.scala:85) at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) ... - sparse mmul at geometry of 1000 x 1000 %*% 1000 x 1000 density = .02. 5 runs *** FAILED **

          People

          • Assignee:
            Andrew_Palumbo Andrew Palumbo
            Reporter:
            Andrew_Palumbo Andrew Palumbo
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development