Uploaded image for project: 'Mahout'
  1. Mahout
  2. MAHOUT-1001

Performance improvement in recommenditembased

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.6
    • Fix Version/s: 0.7
    • Labels:
      None

      Description

      While running the recommendations with ASFEMail dataset using the example script provided with mahout, we noticed that execution time for unsymmetrify mapper is very long. While profiling the task we noticed a hotspot consuming high CPU cycles. Please find the attached patch addressing issue and optimizes the unsymmetrify mapper class. This patch while retaining functionality(verified the output with and without patch) speeds up the unsymmetrify mapper by more then 5X on x86 architectures.

      1. RowSimilarityJob.patch
        2 kB
        Bhaskar Devireddy

        Activity

        Hide
        hudson Hudson added a comment -

        Integrated in Mahout-Quality #1449 (See https://builds.apache.org/job/Mahout-Quality/1449/)
        MAHOUT-1001 optimization of vector allocation (Revision 1330414)

        Result = SUCCESS
        srowen : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1330414
        Files :

        • /mahout/trunk/core/src/main/java/org/apache/mahout/math/hadoop/similarity/cooccurrence/RowSimilarityJob.java
        Show
        hudson Hudson added a comment - Integrated in Mahout-Quality #1449 (See https://builds.apache.org/job/Mahout-Quality/1449/ ) MAHOUT-1001 optimization of vector allocation (Revision 1330414) Result = SUCCESS srowen : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1330414 Files : /mahout/trunk/core/src/main/java/org/apache/mahout/math/hadoop/similarity/cooccurrence/RowSimilarityJob.java
        Hide
        srowen Sean Owen added a comment -

        Looks good, I've committed.

        Show
        srowen Sean Owen added a comment - Looks good, I've committed.

          People

          • Assignee:
            srowen Sean Owen
            Reporter:
            bhaskar.devireddy Bhaskar Devireddy
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Due:
              Created:
              Updated:
              Resolved:

              Development