[SPARK-6239] Spark MLlib fpm#FPGrowth minSupport should use long instead

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Invalid
• Affects Version/s: 1.3.0
• Component/s: MLlib
• Assignee: Unassigned
• Reporter: Littlestar
• Created: 10/Mar/15 06:50
• Updated: 04/Oct/15 15:45
• Resolved: 10/Mar/15 10:33

Description

Spark MLlib fpm#FPGrowth minSupport should use long instead

==============
val minCount = math.ceil(minSupport * count).toLong
because:
1. [count]numbers of datasets is not kown before read.
2. [minSupport ]double precision.

from mahout#FPGrowthDriver.java
addOption("minSupport", "s", "(Optional) The minimum number of times a co-occurrence must be present."
+ " Default Value: 3", "3");

I just want to set minCount=2 for test.
Thanks.

Issue Links

• is duplicated by: SPARK-10920 another constructor for FPGrowth algorithm to support the absolute value for support
• links to: [Github] Pull Request #5246 (kretes)