[HIVEMALL-18] Support approx_distinct_count UDAF using HyperLogLog

• Type: Sub-task
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.5.0
• Assignee: Makoto Yui
• Reporter: Makoto Yui
• Created: 15/Nov/16 11:52
• Updated: 24/Nov/17 07:49
• Resolved: 21/Nov/17 12:51

Description

https://github.com/addthis/stream-lib could be used for underlying library.

http://www.slideshare.net/bzamecnik/hyperloglog-in-hive-how-to-count-sheep-efficiently
https://databricks.com/blog/2016/05/19/approximate-algorithms-in-apache-spark-hyperloglog-and-quantiles.html

There exist several HLL implementations as Hive UDAF.
https://github.com/MLnick/hive-udf/wiki
https://github.com/klout/brickhouse

Issue Links

• blocks: HIVEMALL-21 [Umbrella] Release Hivemall v0.5.0
• links to: GitHub Pull Request #125