Mahout
  1. Mahout
  2. MAHOUT-640

Implementation of refresh in SVDRecommender

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.4
    • Fix Version/s: 0.5
    • Labels:
      None

      Description

      SVDRecommender (in package org.apache.mahout.cf.taste.impl.recommender.svd) and associated classes do not properly implement refresh.

      Plan:

      • make the AbstractFactorizer class implement refreshable.
      • complete the implementation of refresh in SVDRecommender.
      1. refreshable_svd.patch
        15 kB
        Chris Newell
      2. refreshable_svd_v2.patch
        19 kB
        Chris Newell
      3. refreshable_svd_v3.patch
        8 kB
        Chris Newell

        Activity

        Chris Newell created issue -
        Chris Newell made changes -
        Field Original Value New Value
        Status Open [ 1 ] Patch Available [ 10002 ]
        Chris Newell made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Chris Newell made changes -
        Comment [ Patch to make SVDRecommender and the underlying factorization refreshable.

        Also included in the patch is a new class called PersistentSVDRecommender which allows computed factorizations to be saved and reloaded.
        - if the file specified in the constructor does not exist PersistentSVDRecommender computes the factorization and stores it in the file.
        - however, if the file does exist it loads the factorization and will only recompute it if you call refresh().
        - if the specified file is null PersistentSVDRecommender behaves exactly like SVDRecommender.

        The idea is that PersistentSVDRecommender can start up quickly and provide predictions whilst an updated factorization is being computed (as this can take a long time). It also allows you to compute factorizations on one machine and then distribute them to other machines which provide predictions.

        Any comments or suggestions would be very welcome. ]
        Chris Newell made changes -
        Attachment refreshable_svd.patch [ 12475904 ]
        Chris Newell made changes -
        Attachment refreshable_svd_v2.patch [ 12475930 ]
        Chris Newell made changes -
        Attachment refreshable_svd_v3.patch [ 12476114 ]
        Chris Newell made changes -
        Attachment refreshable_svd_v3.patch [ 12476114 ]
        Chris Newell made changes -
        Attachment refreshable_svd_v3.patch [ 12476115 ]
        Sean Owen made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Sean Owen made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Sean Owen
            Reporter:
            Chris Newell
          • Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 408h
              408h
              Remaining:
              Remaining Estimate - 408h
              408h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development