Mahout
  1. Mahout
  2. MAHOUT-609

Add an option to make RecommenderJob write out it's computed item similarities

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.1
    • Fix Version/s: 0.8
    • Labels:

      Description

      As RecommenderJob already includes the computation of similar items, we should an add option that makes it write out those similar items in the same format as ItemSimilarityJob does, so that users interested in both recommendations and similar items do not have to run two jobs.

      1. MAHOUT-609.patch
        6 kB
        Bala Rajagopal

        Activity

        Hide
        Sean Owen added a comment -

        I think this is a worthy change for next release

        Show
        Sean Owen added a comment - I think this is a worthy change for next release
        Hide
        Sebastian Schelter added a comment -

        I lost track of this but I'll definitely implement it for 0.6

        Show
        Sebastian Schelter added a comment - I lost track of this but I'll definitely implement it for 0.6
        Hide
        Sean Owen added a comment -

        Sebastian you want me to have a look? I'm combing through 0.6 issues to start to drive towards 0 for 0.6.

        Show
        Sean Owen added a comment - Sebastian you want me to have a look? I'm combing through 0.6 issues to start to drive towards 0 for 0.6.
        Hide
        Sebastian Schelter added a comment -

        Take it if you want to

        Show
        Sebastian Schelter added a comment - Take it if you want to
        Hide
        Raphael Cendrillon added a comment -

        What's the status of this? I could take a look if it's still open.

        Show
        Raphael Cendrillon added a comment - What's the status of this? I could take a look if it's still open.
        Hide
        Sebastian Schelter added a comment -

        I'd be happy to see this done!

        Show
        Sebastian Schelter added a comment - I'd be happy to see this done!
        Hide
        Bala Rajagopal added a comment -

        Patch file contains changes to add an option to the RecommenderJob to write out the MostSimilarItems matrix.

        Show
        Bala Rajagopal added a comment - Patch file contains changes to add an option to the RecommenderJob to write out the MostSimilarItems matrix.
        Hide
        Raphael Cendrillon added a comment -

        Thanks Bala! Also, please feel free to assign this jira to yourself.

        Show
        Raphael Cendrillon added a comment - Thanks Bala! Also, please feel free to assign this jira to yourself.
        Hide
        Bala Rajagopal added a comment -

        Can't find an "Assign to me" button. I guess I don't have the privileges to reassign tickets.

        Show
        Bala Rajagopal added a comment - Can't find an "Assign to me" button. I guess I don't have the privileges to reassign tickets.
        Hide
        Dan Brickley added a comment -

        Which of these does it work with?

        TellyClub:trunk danbri$ grep RecommenderJob src/conf/*
        src/conf/driver.classes.props:org.apache.mahout.cf.taste.hadoop.item.RecommenderJob = recommenditembased : Compute recommendations using item-based collaborative filtering
        src/conf/driver.classes.props:org.apache.mahout.cf.taste.hadoop.als.RecommenderJob = recommendfactorized : Compute recommendations using the factorization of a rating matrix

        looking at ...

        patching file core/src/main/java/org/apache/mahout/cf/taste/hadoop/similarity/item/ItemSimilarityJob.java
        patching file core/src/main/java/org/apache/mahout/cf/taste/hadoop/item/RecommenderJob.java

        ... is it safe to assume it affects only behaviour of 'recommenditembased' task, and not 'recommendfactorized'? Could it work with both easily?

        Show
        Dan Brickley added a comment - Which of these does it work with? TellyClub:trunk danbri$ grep RecommenderJob src/conf/* src/conf/driver.classes.props:org.apache.mahout.cf.taste.hadoop.item.RecommenderJob = recommenditembased : Compute recommendations using item-based collaborative filtering src/conf/driver.classes.props:org.apache.mahout.cf.taste.hadoop.als.RecommenderJob = recommendfactorized : Compute recommendations using the factorization of a rating matrix looking at ... patching file core/src/main/java/org/apache/mahout/cf/taste/hadoop/similarity/item/ItemSimilarityJob.java patching file core/src/main/java/org/apache/mahout/cf/taste/hadoop/item/RecommenderJob.java ... is it safe to assume it affects only behaviour of 'recommenditembased' task, and not 'recommendfactorized'? Could it work with both easily?
        Hide
        Bala Rajagopal added a comment -

        Yes, the current patch works only for the recommendeditembased task. Looking at the ticket description, I assumed that the RecommenderJob in context is the org.apache.mahout.cf.taste.hadoop.item.RecommenderJob (recommendeditembased task) and not the als.RecommenderJob. We had a requirement that met the ticket description, hence we made the changes and submitted it as a patch. I would assume that a new ticket will be created (in the future) when there is a need to extend this functionality to the recommendfactorized task.

        Show
        Bala Rajagopal added a comment - Yes, the current patch works only for the recommendeditembased task. Looking at the ticket description, I assumed that the RecommenderJob in context is the org.apache.mahout.cf.taste.hadoop.item.RecommenderJob (recommendeditembased task) and not the als.RecommenderJob. We had a requirement that met the ticket description, hence we made the changes and submitted it as a patch. I would assume that a new ticket will be created (in the future) when there is a need to extend this functionality to the recommendfactorized task.
        Hide
        Sebastian Schelter added a comment -

        Dan Brickley It cannot work with 'recommendfactorized' as there is no item similarity computation involved.

        Show
        Sebastian Schelter added a comment - Dan Brickley It cannot work with 'recommendfactorized' as there is no item similarity computation involved.
        Hide
        Sebastian Schelter added a comment -

        Added option 'outputPathForSimilarityMatrix', if this is specified, the similarity matrix will be written to that path in text format

        Show
        Sebastian Schelter added a comment - Added option 'outputPathForSimilarityMatrix', if this is specified, the similarity matrix will be written to that path in text format
        Hide
        Hudson added a comment -

        Integrated in Mahout-Quality #1829 (See https://builds.apache.org/job/Mahout-Quality/1829/)
        MAHOUT-609 Add an option to make RecommenderJob write out it's computed item similarities (Revision 1435084)

        Result = SUCCESS
        ssc : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1435084
        Files :

        • /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/item/RecommenderJob.java
        • /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/similarity/item/ItemSimilarityJob.java
        • /mahout/trunk/core/src/test/java/org/apache/mahout/cf/taste/hadoop/item/RecommenderJobTest.java
        Show
        Hudson added a comment - Integrated in Mahout-Quality #1829 (See https://builds.apache.org/job/Mahout-Quality/1829/ ) MAHOUT-609 Add an option to make RecommenderJob write out it's computed item similarities (Revision 1435084) Result = SUCCESS ssc : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1435084 Files : /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/item/RecommenderJob.java /mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/similarity/item/ItemSimilarityJob.java /mahout/trunk/core/src/test/java/org/apache/mahout/cf/taste/hadoop/item/RecommenderJobTest.java

          People

          • Assignee:
            Sebastian Schelter
            Reporter:
            Sebastian Schelter
          • Votes:
            1 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development