Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-1414 Add Apache Spark implementation to BigPetStore
  3. BIGTOP-1537

[BigPetStore] Add Spark Product Recommender example

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.9.0
    • 1.0.0
    • blueprints
    • None

    Description

      We should add an example for using Spark and MLlib to build an item recommender.

      Two challenges:
      1. The data generator does not generate user product ratings. We need a way to provide a metric for the "strength" of an interaction between a user and product. This could be the normalized purchase frequency for each product. Further evaluation is needed.

      2. How to evaluate the recommendations. We will want to divide the user data into 2 groups: validation and training. For the validation group, we may want to drop certain products and see if the recommender fills in those products or something similar.

      Attachments

        1. BIGTOP-1537.patch
          10 kB
          R J Nowling

        Issue Links

          is blocked by

          Sub-task - The sub-task of the issue BIGTOP-1535 Add Spark ETL script to BigPetStore

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. BIGTOP-1366 Updated, Richer Model for Generating Data for BigPetStore

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              rnowling R J Nowling
              rnowling R J Nowling
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: