Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-19939

Add support for association rules in ML

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.2.0
    • 3.1.0
    • ML
    • None

    Description

      Adding another essential characteristic for the Association Rule in Spark ml.fpm.

      Support is an indication of how frequently the itemset of an association rule appears in the database and suggests if the rules are generally applicable to the dateset. refer to https://en.wikipedia.org/wiki/Association_rule_learning for more details.

      Before adding support:

      rules confidence
      beer -> soda 0.5
      pecan -> milk 0.6

      After adding support:

      rules confidence support
      beer -> soda 0.5 0.3
      pecan -> milk 0.6 0.01

      Thus to allow a better understanding for the generated association rules.

      Update:
      Another property for association rule is Lift, but I'm not sure if it's popular enough. Please comment below if you find Lift useful.

      Attachments

        Activity

          People

            huaxingao Huaxin Gao
            yuhaoyan yuhao yang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: